Sep 28 15:48:21 devstack cinder-volume[75633]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:48:21 devstack cinder-volume[75633]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:48:21 devstack cinder-volume[75633]: we strongly recommend against using it for new projects. Sep 28 15:48:21 devstack cinder-volume[75633]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:48:21 devstack cinder-volume[75633]: framework. For more detail see Sep 28 15:48:21 devstack cinder-volume[75633]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:48:21 devstack cinder-volume[75633]: import eventlet # noqa Sep 28 15:48:24 devstack cinder-volume[75633]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:48:24 devstack cinder-volume[75633]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:48:24 devstack cinder-volume[75633]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:48:25 devstack cinder-volume[75633]: INFO dbcounter [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Registered counter for database cinder Sep 28 15:48:25 devstack cinder-volume[75633]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:48:25 devstack cinder-volume[75633]: DEBUG dbcounter [-] [75633] Writer thread running {{(pid=75633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:48:25 devstack cinder-volume[75633]: INFO cinder.rpc [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:48:25 devstack cinder-volume[75633]: INFO cinder.rpc [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:48:25 devstack cinder-volume[75633]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:48:25 devstack cinder-volume[75633]: INFO cinder.volume.manager [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Determined volume DB was empty at startup. Sep 28 15:48:25 devstack cinder-volume[75633]: DEBUG cinder.volume.manager [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75633) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:48:25 devstack cinder-volume[75633]: INFO cinder.volume.manager [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 15:48:25 devstack cinder-volume[75633]: WARNING stevedore.named [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:48:25 devstack cinder-volume[75633]: WARNING castellan.key_manager [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:48:25 devstack cinder-volume[75633]: WARNING cinder.keymgr.conf_key_mgr [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:48:25 devstack cinder-volume[75633]: DEBUG cinder.volume.drivers.lvm [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75633) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 15:48:25 devstack cinder-volume[75633]: DEBUG oslo_concurrency.processutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_concurrency.processutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] CMD "cinder-rtstool verify" returned: 0 in 0.480s {{(pid=75633) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:48:26 devstack cinder-volume[75633]: INFO cinder.rpc [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 15:48:26 devstack cinder-volume[75633]: INFO cinder.rpc [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 15:48:26 devstack cinder-volume[75633]: WARNING stevedore.named [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:48:26 devstack cinder-volume[75633]: WARNING castellan.key_manager [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:48:26 devstack cinder-volume[75633]: INFO cinder.volume.manager [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_db.sqlalchemy.engines [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:48:26 devstack cinder-volume[75633]: INFO oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Starting 1 workers Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Started child 75789 {{(pid=75633) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Full set of CONF: {{(pid=75633) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] ******************************************************************************** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Configuration options gathered from: {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:48:26 devstack cinder-volume[75789]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] ================================================================================ {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] allow_availability_zone_fallback = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] allow_compression_on_image_upload = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] allowed_direct_url_schemes = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] api_rate_limit = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] auth_strategy = keystone {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] az_cache_duration = 3600 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_availability_zone = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_host = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_stats_polling_interval = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backup_api_class = cinder.backup.api.API {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backup_name_template = backup-%s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backup_use_same_host = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backup_use_temp_snapshot = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] chap_password = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] chap_username = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_internal_tenant_project_id = fbbbe40bae1f4c778cecd0e116381b9a {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_internal_tenant_user_id = ecab8ccc28a14af49011b7be8c9184b0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cloned_volume_same_az = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cluster = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] compression_format = gzip {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] compute_api_class = cinder.compute.nova.API {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] config_dir = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] config_source = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] control_exchange = openstack {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] debug = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] default_availability_zone = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] default_group_type = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] default_volume_type = lvmdriver-1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] disk_geometry = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] driver_client_cert = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] driver_client_cert_key = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] driver_data_namespace = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] driver_ssl_cert_path = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] driver_ssl_cert_verify = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] driver_use_ssl = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] enable_force_upload = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] enable_new_services = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] enable_unsupported_driver = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] enforce_multipath_for_image_xfer = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] filter_function = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_api_insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_api_ssl_compression = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_ca_certificates_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_catalog_info = image:glance:publicURL {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_num_retries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance_request_timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] goodness_function = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] graceful_shutdown_timeout = 5 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] group_api_class = cinder.group.api.API {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] host = devstack {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_compress_on_upload = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_conversion_address_space_limit = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_conversion_cpu_limit = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_conversion_disable = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_introspection_address_space_limit = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_introspection_cpu_limit = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_upload_use_cinder_backend = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_upload_use_internal_tenant = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_volume_cache_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_volume_cache_max_count = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] image_volume_cache_max_size_gb = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] init_host_max_objects_retrieval = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] instance_format = [instance: %(uuid)s] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] iscsi_target_flags = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] iscsi_write_cache = on {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] iser_helper = tgtadm {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] iser_ip_address = 192.168.122.178 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] iser_port = 3260 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_color = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_config_append = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_dir = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_options = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_rotate_interval = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_rotate_interval_type = days {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] log_rotation_type = none {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] max_age = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] max_logfile_count = 30 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] max_logfile_size_mb = 200 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] max_over_subscription_ratio = 20.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] message_reap_interval = 86400 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] message_ttl = 2592000 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] migration_create_volume_timeout_secs = 300 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] monkey_patch = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] monkey_patch_modules = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] my_ip = 192.168.122.178 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] no_snapshot_gb_quota = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] num_iser_scan_tries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] num_shell_tries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] num_volume_device_scan_tries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] nvmeof_conn_info_version = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] nvmet_ns_id = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] nvmet_port_id = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_max_limit = 1000 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_volume_ext_list = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_volume_listen_port = 8776 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_volume_use_ssl = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] osapi_volume_workers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] per_volume_size_limit = -1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] periodic_fuzzy_delay = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] periodic_interval = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] public_endpoint = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] publish_errors = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_backup_gigabytes = 1000 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_backups = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_gigabytes = 1000 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_groups = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_snapshots = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] quota_volumes = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] rate_limit_burst = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] rate_limit_except_level = CRITICAL {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] rate_limit_interval = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] reinit_driver_count = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] replication_device = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] report_discard_supported = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] report_interval = 120 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] reservation_clean_interval = 86400 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] reservation_expire = 86400 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] reserved_image_namespaces = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] reserved_percentage = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] rpc_response_timeout = 120 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] run_external_periodic_tasks = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] scst_target_driver = iscsi {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] scst_target_iqn_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_down_time = 720 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] shell_completion = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] snapshot_name_template = snapshot-%s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] snapshot_same_host = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] split_loggers = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] state_path = /opt/stack/data/cinder {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] storage_availability_zone = nova {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] storage_protocol = iSCSI {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] syslog_log_facility = LOG_USER {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] target_helper = lioadm {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] target_ip_address = 192.168.122.178 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] target_port = 3260 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] target_protocol = iscsi {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] target_secondary_ip_addresses = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] trace_flags = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] transport_url = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] until_refresh = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_chap_auth = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_default_quota_class = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_journal = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_json = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_multipath_for_image_xfer = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_stderr = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] use_syslog = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] verify_glance_signatures = enabled {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_api_class = cinder.volume.api.API {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_backend_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_clear = zero {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_clear_ionice = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_clear_size = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_copy_bps_limit = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_dd_blocksize = 1M {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_name_template = volume-%s {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75789]: INFO cinder.volume.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_service_inithost_offload = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volume_usage_audit_period = month {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] zoning_mode = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_concurrency.disable_process_locking = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.auth_section = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.auth_type = password {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.auth_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.cache = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.include_service_catalog = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.interface = public {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_password = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcache_username = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.region_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.service_type = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.backend = dogpile.cache.null {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.backend_argument = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.backend_expiration_time = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.config_prefix = cache.oslo {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.debug_cache_backend = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.enable_retry_client = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.enable_socket_keepalive = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.expiration_time = 600 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.hashclient_retry_attempts = 2 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_dead_retry = 300 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_pool_maxsize = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_sasl_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.password = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.proxies = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.redis_db = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.redis_server = localhost:6379 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.retry_attempts = 2 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.retry_delay = 0.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.socket_keepalive_count = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.socket_keepalive_idle = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.socket_keepalive_interval = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.socket_timeout = 1.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.tls_allowed_ciphers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.tls_cafile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.tls_certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.tls_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.tls_keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cache.username = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] coordination.backend_url = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.asyncio_connection = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.asyncio_slave_connection = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.backend = sqlalchemy {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.connection = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.connection_debug = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.connection_parameters = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.connection_recycle_time = 3600 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.connection_trace = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.db_inc_retry_interval = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.db_max_retries = 20 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.db_max_retry_interval = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.db_retry_interval = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.max_overflow = 50 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.max_pool_size = 5 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.max_retries = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.mysql_wsrep_sync_wait = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.pool_timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.retry_interval = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.slave_connection = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.sqlite_synchronous = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.synchronous_reader = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] database.use_db_reconnect = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_tracing.insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.connection_string = messaging:// {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.es_doc_type = notification {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.es_scroll_size = 10000 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.es_scroll_time = 2m {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.filter_error_trace = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.hmac_keys = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.sentinel_service_name = mymaster {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.socket_timeout = 0.1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.trace_requests = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler.trace_sqlalchemy = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler_jaeger.process_tags = {} {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler_jaeger.service_name_prefix = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] profiler_otlp.service_name_prefix = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.enforce_new_defaults = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.policy_default_rule = default {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.policy_file = policy.yaml {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.group = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.helper_command = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] privsep_osbrick.user = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.group = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.helper_command = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] cinder_sys_admin.user = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.auth_section = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.auth_type = password {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.cafile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.collect_timing = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.send_service_user_token = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.split_loggers = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.tls_ciphers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] service_user.tls_min_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.auth_section = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.auth_type = password {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.collect_timing = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.region_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.split_loggers = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.tls_ciphers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] glance.tls_min_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.backend_availability_zone = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.chap_password = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.chap_username = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.disk_geometry = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.driver_client_cert = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.driver_client_cert_key = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.driver_data_namespace = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.driver_use_ssl = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.extra_capabilities = {} {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.filter_function = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.goodness_function = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack sudo[75797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 15:48:26 devstack sudo[75797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.iscsi_target_flags = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.iscsi_write_cache = on {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.iser_helper = tgtadm {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.iser_port = 3260 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.lvm_share_target = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.lvm_type = auto {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.num_shell_tries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.replication_device = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.report_discard_supported = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.reserved_percentage = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:26 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.target_helper = tgtadm {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.target_port = 3260 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.target_protocol = iscsi {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.trace_flags = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.unique_fqdn_network = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.use_chap_auth = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_backend_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_clear = zero {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_clear_ionice = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_clear_size = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_reports.file_event_handler = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_reports.log_dir = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.backend_host = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.chap_password = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.chap_username = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.disk_geometry = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.driver_client_cert = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.extra_capabilities = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.filter_function = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.goodness_function = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.iser_helper = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.iser_ip_address = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.iser_port = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.lvm_share_target = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.lvm_type = auto {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.num_shell_tries = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.replication_device = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.report_discard_supported = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.reserved_percentage = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.scst_target_driver = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.storage_protocol = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.target_helper = lioadm {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.target_ip_address = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.target_port = 3260 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.trace_flags = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.use_chap_auth = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_clear = zero {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_clear_size = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] lvmdriver-1.volumes_dir = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_notifications.driver = [] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_notifications.retry = -1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] key_manager.fixed_key = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.barbican_api_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.barbican_endpoint = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.barbican_endpoint_type = public {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.barbican_region_name = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.cafile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.collect_timing = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.number_of_retries = 60 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.retry_delay = 1 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.send_service_user_token = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.split_loggers = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.tls_ciphers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.tls_min_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.verify_ssl = True {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican.verify_ssl_path = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.auth_section = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.auth_type = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.cafile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.certfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.collect_timing = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.insecure = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.keyfile = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.split_loggers = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.timeout = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.tls_ciphers = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] barbican_service_user.tls_min_version = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.approle_role_id = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.approle_secret_id = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.auth_method = approle {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.auth_path = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.kv_mountpoint = secret {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.kv_path = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.kv_version = 2 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.namespace = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.root_token_id = **** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.ssl_ca_crt_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.timeout = 60.0 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.token_file = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.token_role = None {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.use_ssl = False {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:48:27 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] ******************************************************************************** {{(pid=75633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:48:27 devstack sudo[75797]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.398s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:27 devstack sudo[75920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:27 devstack sudo[75920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:27 devstack sudo[75920]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.365s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:48:27 devstack cinder-volume[75789]: INFO cinder.brick.local_dev.lvm [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:27 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:27 devstack sudo[76021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:48:27 devstack sudo[76021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:28 devstack sudo[76021]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG cinder.brick.local_dev.lvm [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75789) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:28 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:28 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:28 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.569s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:28 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:28 devstack sudo[76301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:28 devstack sudo[76301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:29 devstack sudo[76301]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.353s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:29 devstack sudo[76405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 15:48:29 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:29 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.299s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:29 devstack sudo[76408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:48:29 devstack sudo[76408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:29 devstack sudo[76408]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.382s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:29 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:29 devstack sudo[76492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:48:29 devstack sudo[76492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:30 devstack sudo[76492]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:30 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:30 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:30 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:30 devstack sudo[76566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:30 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:30 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:30 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:30 devstack sudo[76589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:30 devstack sudo[76589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:31 devstack sudo[76589]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:31 devstack cinder-volume[75789]: INFO cinder.volume.drivers.lvm [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:31 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:31 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:31 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:31 devstack sudo[76602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:48:31 devstack sudo[76602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:31 devstack sudo[76602]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:31 devstack sudo[76605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:31 devstack sudo[76605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:31 devstack sudo[76605]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:31 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:31 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:31 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:32 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:32 devstack sudo[76611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:32 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:32 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:32 devstack cinder-volume[75789]: INFO cinder.volume.driver [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG cinder.volume.driver [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75789) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_db.sqlalchemy.engines [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writer thread running {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG cinder.db.api [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Building query based on filter {{(pid=75789) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG cinder.image.image_utils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75789) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:48:32 devstack cinder-volume[75789]: INFO cinder.keymgr.migration [None req-ae3351b8-c6d3-4532-afad-dbdcadc3a82d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:32 devstack sudo[76614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:48:32 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:32 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:32 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:32 devstack sudo[76620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:32 devstack sudo[76620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:33 devstack sudo[76620]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:33 devstack sudo[76623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:33 devstack sudo[76623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:33 devstack sudo[76623]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:33 devstack sudo[76626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:33 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:33 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG cinder.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Notifying Schedulers of capabilities ... {{(pid=75789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:48:33 devstack cinder-volume[75789]: INFO cinder.volume.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Driver initialization completed successfully. Sep 28 15:48:33 devstack cinder-volume[75789]: INFO cinder.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Initiating service 2 cleanup Sep 28 15:48:33 devstack cinder-volume[75789]: INFO cinder.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Service 2 cleanup completed. Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG cinder.service [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Creating RPC server for service cinder-volume {{(pid=75789) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:48:33 devstack cinder-volume[75789]: DEBUG cinder.service [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75789) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:48:34 devstack cinder-volume[75789]: INFO cinder.volume.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 15:48:34 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:48:34 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:34 devstack sudo[76630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:48:34 devstack sudo[76630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:34 devstack sudo[76630]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:34 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:34 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:34 devstack sudo[76635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:34 devstack sudo[76635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:34 devstack sudo[76635]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:34 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:34 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:34 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:48:34 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:35 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:35 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:35 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:48:35 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:48:35 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:48:35 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Sep 28 15:48:35 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:48:35 devstack cinder-volume[75789]: INFO cinder.volume.manager [None req-182890f9-6bb2-4f96-8844-670abd6d2fe4 None None] Driver post RPC initialization completed successfully. Sep 28 15:48:36 devstack cinder-volume[75633]: DEBUG dbcounter [-] [75633] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:48:43 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:48:45 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:49:16 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager._thread_info {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:49:16 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread count: 6 {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:49:16 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread info: [<_MainThread(MainThread, started 135099039219840)>, , , , , ] {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:50:16 devstack sudo[81756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:50:16 devstack sudo[81756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:50:16 devstack sudo[81756]: pam_unix(sudo:session): session closed for user root Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:50:16 devstack sudo[81759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:50:16 devstack sudo[81759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:50:16 devstack sudo[81759]: pam_unix(sudo:session): session closed for user root Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:50:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:50:16 devstack sudo[81762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:50:16 devstack sudo[81762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:50:17 devstack sudo[81762]: pam_unix(sudo:session): session closed for user root Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:50:17 devstack sudo[81765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:50:17 devstack sudo[81765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:50:17 devstack sudo[81765]: pam_unix(sudo:session): session closed for user root Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG cinder.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Notifying Schedulers of capabilities ... {{(pid=75789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager._thread_info {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread count: 6 {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:50:17 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread info: [<_MainThread(MainThread, started 135099039219840)>, , , , , ] {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:50:45 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writing DB stats cinder:SELECT=1 {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:50:45 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writing DB stats cinder:UPDATE=1 {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:51:16 devstack sudo[83255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:51:16 devstack sudo[83255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:51:16 devstack sudo[83255]: pam_unix(sudo:session): session closed for user root Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:51:16 devstack sudo[83258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:51:16 devstack sudo[83258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:51:16 devstack sudo[83258]: pam_unix(sudo:session): session closed for user root Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:51:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:51:16 devstack sudo[83261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:51:16 devstack sudo[83261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:51:17 devstack sudo[83261]: pam_unix(sudo:session): session closed for user root Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:51:17 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:51:17 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:51:17 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG cinder.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Notifying Schedulers of capabilities ... {{(pid=75789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager._thread_info {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread count: 6 {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:51:17 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread info: [<_MainThread(MainThread, started 135099039219840)>, , , , , ] {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:52:16 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:52:16 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:52:16 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:52:16 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:52:16 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:52:16 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:52:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:52:16 devstack sudo[84676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:52:16 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:52:17 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:52:17 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:52:17 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:52:17 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG cinder.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Notifying Schedulers of capabilities ... {{(pid=75789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager._thread_info {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread count: 6 {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:52:17 devstack cinder-volume[75789]: DEBUG cinder.volume.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] thread info: [<_MainThread(MainThread, started 135099039219840)>, , , , , ] {{(pid=75789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:52:45 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writing DB stats cinder:SELECT=1 {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:52:45 devstack cinder-volume[75789]: DEBUG dbcounter [-] [75789] Writing DB stats cinder:UPDATE=1 {{(pid=75789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG oslo_service.periodic_task [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG cinder.volume.drivers.lvm [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Updating volume stats {{(pid=75789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:16 devstack sudo[85707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:53:16 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:16 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:16 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:16 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:16 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:16 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:16 devstack sudo[85792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:53:16 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:17 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:17 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:53:17 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:17 devstack cinder-volume[75633]: INFO oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Caught SIGTERM, stopping children Sep 28 15:53:17 devstack cinder-volume[75633]: DEBUG oslo_concurrency.lockutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Acquiring lock "singleton_lock" {{(pid=75633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:17 devstack cinder-volume[75633]: DEBUG oslo_concurrency.lockutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Acquired lock "singleton_lock" {{(pid=75633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:17 devstack cinder-volume[75633]: DEBUG oslo_concurrency.lockutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Releasing lock "singleton_lock" {{(pid=75633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:17 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Stop services. {{(pid=75633) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 15:53:17 devstack cinder-volume[75633]: DEBUG oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Killing children. {{(pid=75633) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 15:53:17 devstack cinder-volume[75633]: INFO oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Waiting on 1 children to exit Sep 28 15:53:17 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:17 devstack cinder-volume[75789]: DEBUG oslo_concurrency.processutils [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:17 devstack cinder-volume[75789]: DEBUG cinder.manager [None req-3bfbe58c-b49f-4bc1-88e7-04ee430d5f36 None None] Notifying Schedulers of capabilities ... {{(pid=75789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:53:18 devstack cinder-volume[75789]: DEBUG oslo_concurrency.lockutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Acquiring lock "singleton_lock" {{(pid=75789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:18 devstack cinder-volume[75789]: DEBUG oslo_concurrency.lockutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Acquired lock "singleton_lock" {{(pid=75789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:18 devstack cinder-volume[75789]: DEBUG oslo_concurrency.lockutils [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Releasing lock "singleton_lock" {{(pid=75789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:19 devstack cinder-volume[75789]: WARNING amqp [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:53:19 devstack cinder-volume[75789]: WARNING amqp [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:53:19 devstack cinder-volume[75633]: INFO oslo_service.backend._eventlet.service [None req-c3eccd25-e172-4c9e-ad22-4cdfba53c26f None None] Child 75789 exited with status 0 Sep 28 15:53:19 devstack cinder-volume[85803]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:53:19 devstack cinder-volume[85803]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:53:19 devstack cinder-volume[85803]: we strongly recommend against using it for new projects. Sep 28 15:53:19 devstack cinder-volume[85803]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:53:19 devstack cinder-volume[85803]: framework. For more detail see Sep 28 15:53:19 devstack cinder-volume[85803]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:53:19 devstack cinder-volume[85803]: import eventlet # noqa Sep 28 15:53:21 devstack cinder-volume[85803]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:21 devstack cinder-volume[85803]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:21 devstack cinder-volume[85803]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:22 devstack cinder-volume[85803]: INFO dbcounter [None req-16136661-310a-455c-8e97-7b111114e71c None None] Registered counter for database cinder Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_db.sqlalchemy.engines [None req-16136661-310a-455c-8e97-7b111114e71c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG dbcounter [-] [85803] Writer thread running {{(pid=85803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:53:22 devstack cinder-volume[85803]: INFO cinder.rpc [None req-16136661-310a-455c-8e97-7b111114e71c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:53:22 devstack cinder-volume[85803]: INFO cinder.rpc [None req-16136661-310a-455c-8e97-7b111114e71c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_db.sqlalchemy.engines [None req-16136661-310a-455c-8e97-7b111114e71c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:22 devstack cinder-volume[85803]: INFO cinder.volume.manager [None req-16136661-310a-455c-8e97-7b111114e71c None None] Determined volume DB was empty at startup. Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG cinder.volume.manager [None req-16136661-310a-455c-8e97-7b111114e71c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85803) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:53:22 devstack cinder-volume[85803]: INFO cinder.volume.manager [None req-16136661-310a-455c-8e97-7b111114e71c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 15:53:22 devstack cinder-volume[85803]: WARNING stevedore.named [None req-16136661-310a-455c-8e97-7b111114e71c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:53:22 devstack cinder-volume[85803]: WARNING castellan.key_manager [None req-16136661-310a-455c-8e97-7b111114e71c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:22 devstack cinder-volume[85803]: WARNING cinder.keymgr.conf_key_mgr [None req-16136661-310a-455c-8e97-7b111114e71c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:22 devstack cinder-volume[85803]: INFO cinder.volume.manager [None req-16136661-310a-455c-8e97-7b111114e71c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_db.sqlalchemy.engines [None req-16136661-310a-455c-8e97-7b111114e71c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:22 devstack cinder-volume[85803]: INFO oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Starting 1 workers Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Started child 86018 {{(pid=85803) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Full set of CONF: {{(pid=85803) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] ******************************************************************************** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Configuration options gathered from: {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] ================================================================================ {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] allow_availability_zone_fallback = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] allow_compression_on_image_upload = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] allowed_direct_url_schemes = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] api_rate_limit = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] auth_strategy = keystone {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_availability_zone = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_host = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_stats_polling_interval = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backup_api_class = cinder.backup.api.API {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backup_name_template = backup-%s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backup_use_same_host = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backup_use_temp_snapshot = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] chap_password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] chap_username = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_internal_tenant_project_id = fbbbe40bae1f4c778cecd0e116381b9a {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_internal_tenant_user_id = ecab8ccc28a14af49011b7be8c9184b0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cluster = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] compression_format = gzip {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] compute_api_class = cinder.compute.nova.API {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] config_dir = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] config_source = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] control_exchange = openstack {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] debug = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] default_availability_zone = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] default_group_type = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] default_volume_type = QuobyteHD {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] disk_geometry = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] driver_client_cert = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] driver_client_cert_key = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] driver_data_namespace = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:22 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] driver_ssl_cert_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[86018]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] driver_ssl_cert_verify = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] driver_use_ssl = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] enable_new_services = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] enable_unsupported_driver = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] enabled_backends = ['QuobyteHD'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] enforce_multipath_for_image_xfer = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] filter_function = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_api_insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_api_ssl_compression = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_ca_certificates_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_catalog_info = image:glance:publicURL {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_num_retries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance_request_timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] goodness_function = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] graceful_shutdown_timeout = 5 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] group_api_class = cinder.group.api.API {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] host = devstack {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_compress_on_upload = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_conversion_address_space_limit = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_conversion_cpu_limit = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_conversion_disable = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_introspection_address_space_limit = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_introspection_cpu_limit = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_upload_use_cinder_backend = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_upload_use_internal_tenant = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_volume_cache_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_volume_cache_max_count = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] image_volume_cache_max_size_gb = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] init_host_max_objects_retrieval = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] instance_format = [instance: %(uuid)s] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] iscsi_target_flags = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] iscsi_write_cache = on {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] iser_helper = tgtadm {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] iser_ip_address = 192.168.122.178 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] iser_port = 3260 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_color = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_config_append = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_dir = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_options = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_rotate_interval = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_rotate_interval_type = days {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] log_rotation_type = none {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] max_age = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] max_logfile_count = 30 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] max_logfile_size_mb = 200 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] max_over_subscription_ratio = 20.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] message_reap_interval = 86400 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] message_ttl = 2592000 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] migration_create_volume_timeout_secs = 300 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] monkey_patch = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] monkey_patch_modules = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] my_ip = 192.168.122.178 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] no_snapshot_gb_quota = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] num_iser_scan_tries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] num_shell_tries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] num_volume_device_scan_tries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] nvmeof_conn_info_version = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] nvmet_ns_id = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] nvmet_port_id = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_max_limit = 1000 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_volume_ext_list = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_volume_listen_port = 8776 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_volume_use_ssl = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] osapi_volume_workers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] per_volume_size_limit = -1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] periodic_fuzzy_delay = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] periodic_interval = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] public_endpoint = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] publish_errors = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_backup_gigabytes = 1000 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_backups = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_gigabytes = 1000 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_groups = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_snapshots = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] quota_volumes = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] rate_limit_burst = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] rate_limit_except_level = CRITICAL {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] rate_limit_interval = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] reinit_driver_count = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] replication_device = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] report_discard_supported = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] report_interval = 120 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] reservation_clean_interval = 86400 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] reservation_expire = 86400 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] reserved_image_namespaces = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] reserved_percentage = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] rpc_response_timeout = 120 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] run_external_periodic_tasks = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] scst_target_driver = iscsi {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] scst_target_iqn_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_down_time = 720 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] shell_completion = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] snapshot_name_template = snapshot-%s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] split_loggers = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] state_path = /opt/stack/data/cinder {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] storage_availability_zone = nova {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[86018]: INFO cinder.volume.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.remotefs [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86018) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] storage_protocol = iSCSI {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] syslog_log_facility = LOG_USER {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] target_helper = lioadm {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] target_ip_address = 192.168.122.178 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] target_port = 3260 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] target_protocol = iscsi {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] target_secondary_ip_addresses = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] trace_flags = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] transport_url = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] until_refresh = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_chap_auth = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_default_quota_class = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_journal = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_json = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_multipath_for_image_xfer = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_stderr = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] use_syslog = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] verify_glance_signatures = enabled {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_api_class = cinder.volume.api.API {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_backend_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_clear = zero {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_clear_ionice = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_clear_size = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_copy_bps_limit = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_dd_blocksize = 1M {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_name_template = volume-%s {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_service_inithost_offload = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volume_usage_audit_period = month {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] zoning_mode = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_concurrency.disable_process_locking = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.auth_section = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.auth_type = password {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.auth_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.cache = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.include_service_catalog = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.interface = public {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcache_username = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.region_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.service_type = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.backend = dogpile.cache.null {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.backend_argument = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.backend_expiration_time = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.config_prefix = cache.oslo {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.debug_cache_backend = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.enable_retry_client = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.enable_socket_keepalive = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.expiration_time = 600 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.hashclient_retry_attempts = 2 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_dead_retry = 300 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_pool_maxsize = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_sasl_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.proxies = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.redis_db = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.redis_server = localhost:6379 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.retry_attempts = 2 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.retry_delay = 0.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.socket_keepalive_count = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.socket_keepalive_idle = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.socket_keepalive_interval = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.socket_timeout = 1.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.tls_allowed_ciphers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.tls_cafile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.tls_certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.tls_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.tls_keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cache.username = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] coordination.backend_url = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.asyncio_connection = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.asyncio_slave_connection = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.backend = sqlalchemy {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.connection = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.connection_debug = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.connection_parameters = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.connection_recycle_time = 3600 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.connection_trace = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.db_inc_retry_interval = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.db_max_retries = 20 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.db_max_retry_interval = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.db_retry_interval = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.max_overflow = 50 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.max_pool_size = 5 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.max_retries = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.mysql_wsrep_sync_wait = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.pool_timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.retry_interval = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.slave_connection = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.sqlite_synchronous = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.synchronous_reader = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] database.use_db_reconnect = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_tracing.insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.connection_string = messaging:// {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.es_doc_type = notification {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.es_scroll_size = 10000 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.es_scroll_time = 2m {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.filter_error_trace = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.hmac_keys = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.sentinel_service_name = mymaster {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.socket_timeout = 0.1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.trace_requests = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler.trace_sqlalchemy = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler_jaeger.process_tags = {} {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler_jaeger.service_name_prefix = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] profiler_otlp.service_name_prefix = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.enforce_new_defaults = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.policy_default_rule = default {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.policy_file = policy.yaml {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.group = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.helper_command = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] privsep_osbrick.user = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86018) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.group = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.helper_command = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] cinder_sys_admin.user = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.auth_section = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.auth_type = password {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.cafile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[86018]: WARNING cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.collect_timing = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.send_service_user_token = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.split_loggers = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[86018]: WARNING cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.tls_ciphers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] service_user.tls_min_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.auth_section = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.auth_type = password {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.collect_timing = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.region_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.split_loggers = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.tls_ciphers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] glance.tls_min_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.backend_availability_zone = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.chap_password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.chap_username = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.disk_geometry = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.driver_client_cert = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.driver_client_cert_key = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.driver_data_namespace = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.driver_use_ssl = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.extra_capabilities = {} {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.filter_function = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.goodness_function = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.iscsi_target_flags = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.iscsi_write_cache = on {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.iser_helper = tgtadm {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.iser_port = 3260 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_host = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_login = admin {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_mount_options = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_private_key = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_share_path = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.num_shell_tries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.quobyte_volume_url = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.replication_device = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.report_discard_supported = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.reserved_percentage = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.target_helper = tgtadm {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.target_port = 3260 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.target_protocol = iscsi {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.trace_flags = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.unique_fqdn_network = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.use_chap_auth = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_backend_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_clear = zero {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_clear_ionice = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_clear_size = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_reports.file_event_handler = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_reports.log_dir = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.backend_availability_zone = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.backend_host = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.chap_password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.chap_username = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.chiscsi_conf = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.disk_geometry = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.driver_client_cert = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.driver_data_namespace = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.driver_use_ssl = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.extra_capabilities = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.filter_function = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.goodness_function = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.iser_helper = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.iser_ip_address = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.iser_port = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.iser_target_prefix = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_host = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_login = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_mount_options = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_password = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_private_key = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_share_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_ssh_port = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.num_shell_tries = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.nvmet_port_id = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.replication_device = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.report_discard_supported = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.reserved_percentage = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.scst_target_driver = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.storage_protocol = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.target_helper = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.target_ip_address = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.target_port = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.target_prefix = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.target_protocol = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.trace_flags = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.use_chap_auth = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_clear = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_clear_size = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] QuobyteHD.volumes_dir = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_notifications.driver = [] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_notifications.retry = -1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] key_manager.fixed_key = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.barbican_api_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.barbican_endpoint = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.barbican_endpoint_type = public {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.barbican_region_name = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.cafile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.collect_timing = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.number_of_retries = 60 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.retry_delay = 1 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.send_service_user_token = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.split_loggers = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.tls_ciphers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.tls_min_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.verify_ssl = True {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican.verify_ssl_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.auth_section = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.auth_type = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.cafile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.certfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.collect_timing = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.insecure = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.keyfile = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.split_loggers = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.timeout = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.tls_ciphers = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] barbican_service_user.tls_min_version = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.approle_role_id = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.approle_secret_id = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.auth_method = approle {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.auth_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.kv_mountpoint = secret {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.kv_path = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.kv_version = 2 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.namespace = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.root_token_id = **** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.ssl_ca_crt_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.timeout = 60.0 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.token_file = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.token_role = None {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.use_ssl = False {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:23 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] ******************************************************************************** {{(pid=85803) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:53:23 devstack quobyte-client[86019]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 15:53:23 devstack quobyte-client[86019]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] CMD "mount.quobyte" returned: 1 in 0.181s {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:23 devstack cinder-volume[86018]: INFO cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be ... Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 -c /etc/quobyte/client-cinder.cfg {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:23 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 -c /etc/quobyte/client-cinder.cfg Sep 28 15:53:23 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:23 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.416s {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:23 devstack cinder-volume[86018]: INFO cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be succeeded Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.430s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:23 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:23 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:23 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:24 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.266s {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.volume.driver [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.volume.driver [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1803398132324, 'free_capacity_gb': 1775.1803398132324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86018) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG dbcounter [-] [86018] Writer thread running {{(pid=86018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.db.api [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Building query based on filter {{(pid=86018) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.image.image_utils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86018) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.keymgr.migration [None req-a3769c65-3f01-40f0-99e9-651b40792696 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:24 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:24 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:24 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.260s {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Notifying Schedulers of capabilities ... {{(pid=86018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.volume.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Driver initialization completed successfully. Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Initiating service 3 cleanup Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Service 3 cleanup completed. Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.service [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Creating RPC server for service cinder-volume {{(pid=86018) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.service [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86018) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.volume.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:24 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:24 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:24 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:24 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.287s {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:24 devstack cinder-volume[86018]: INFO cinder.volume.manager [None req-7b2df23e-0d47-415d-8ee4-174676c082d4 None None] Driver post RPC initialization completed successfully. Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86018) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG cinder.volume.drivers.quobyte [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86018) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86018) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:29 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:29 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:29 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG oslo_concurrency.processutils [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.284s {{(pid=86018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:29 devstack cinder-volume[86018]: DEBUG cinder.manager [None req-ac0a5c05-e8d6-49af-a7f7-aceca42360ab None None] Notifying Schedulers of capabilities ... {{(pid=86018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:53:32 devstack cinder-volume[85803]: DEBUG dbcounter [-] [85803] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:33 devstack cinder-volume[85803]: INFO oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Caught SIGTERM, stopping children Sep 28 15:53:33 devstack cinder-volume[85803]: DEBUG oslo_concurrency.lockutils [None req-16136661-310a-455c-8e97-7b111114e71c None None] Acquiring lock "singleton_lock" {{(pid=85803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:33 devstack cinder-volume[85803]: DEBUG oslo_concurrency.lockutils [None req-16136661-310a-455c-8e97-7b111114e71c None None] Acquired lock "singleton_lock" {{(pid=85803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:33 devstack cinder-volume[85803]: DEBUG oslo_concurrency.lockutils [None req-16136661-310a-455c-8e97-7b111114e71c None None] Releasing lock "singleton_lock" {{(pid=85803) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:33 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Stop services. {{(pid=85803) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 15:53:33 devstack cinder-volume[85803]: DEBUG oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Killing children. {{(pid=85803) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 15:53:33 devstack cinder-volume[85803]: INFO oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Waiting on 1 children to exit Sep 28 15:53:34 devstack cinder-volume[86018]: DEBUG dbcounter [-] [86018] Writing DB stats cinder:SELECT=4 {{(pid=86018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:34 devstack cinder-volume[86018]: DEBUG dbcounter [-] [86018] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:37 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-16136661-310a-455c-8e97-7b111114e71c None None] Acquiring lock "singleton_lock" {{(pid=86018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:37 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-16136661-310a-455c-8e97-7b111114e71c None None] Acquired lock "singleton_lock" {{(pid=86018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:37 devstack cinder-volume[86018]: DEBUG oslo_concurrency.lockutils [None req-16136661-310a-455c-8e97-7b111114e71c None None] Releasing lock "singleton_lock" {{(pid=86018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:37 devstack cinder-volume[86018]: WARNING amqp [None req-16136661-310a-455c-8e97-7b111114e71c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:53:37 devstack cinder-volume[86018]: WARNING amqp [None req-16136661-310a-455c-8e97-7b111114e71c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 15:53:37 devstack cinder-volume[85803]: INFO oslo_service.backend._eventlet.service [None req-16136661-310a-455c-8e97-7b111114e71c None None] Child 86018 exited with status 0 Sep 28 15:53:38 devstack cinder-volume[86342]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:53:38 devstack cinder-volume[86342]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:53:38 devstack cinder-volume[86342]: we strongly recommend against using it for new projects. Sep 28 15:53:38 devstack cinder-volume[86342]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:53:38 devstack cinder-volume[86342]: framework. For more detail see Sep 28 15:53:38 devstack cinder-volume[86342]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:53:38 devstack cinder-volume[86342]: import eventlet # noqa Sep 28 15:53:41 devstack cinder-volume[86342]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:53:41 devstack cinder-volume[86342]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:53:41 devstack cinder-volume[86342]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:53:41 devstack cinder-volume[86342]: INFO dbcounter [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Registered counter for database cinder Sep 28 15:53:41 devstack cinder-volume[86342]: DEBUG oslo_db.sqlalchemy.engines [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG dbcounter [-] [86342] Writer thread running {{(pid=86342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:53:42 devstack cinder-volume[86342]: INFO cinder.rpc [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:53:42 devstack cinder-volume[86342]: INFO cinder.rpc [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_db.sqlalchemy.engines [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:42 devstack cinder-volume[86342]: INFO cinder.volume.manager [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Determined volume DB was empty at startup. Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG cinder.volume.manager [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86342) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:53:42 devstack cinder-volume[86342]: WARNING stevedore.named [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:53:42 devstack cinder-volume[86342]: WARNING castellan.key_manager [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:42 devstack cinder-volume[86342]: WARNING cinder.keymgr.conf_key_mgr [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:53:42 devstack cinder-volume[86342]: INFO cinder.volume.manager [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_db.sqlalchemy.engines [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:42 devstack cinder-volume[86342]: INFO oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Starting 1 workers Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Started child 86628 {{(pid=86342) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Full set of CONF: {{(pid=86342) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] ******************************************************************************** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] Configuration options gathered from: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] ================================================================================ {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:53:42 devstack cinder-volume[86628]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] allow_availability_zone_fallback = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] allow_compression_on_image_upload = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] allowed_direct_url_schemes = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] api_rate_limit = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] auth_strategy = keystone {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_availability_zone = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_host = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_stats_polling_interval = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backup_api_class = cinder.backup.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backup_name_template = backup-%s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backup_use_same_host = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backup_use_temp_snapshot = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] chap_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] chap_username = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_internal_tenant_project_id = fbbbe40bae1f4c778cecd0e116381b9a {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_internal_tenant_user_id = ecab8ccc28a14af49011b7be8c9184b0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cluster = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] compression_format = gzip {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] compute_api_class = cinder.compute.nova.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] config_dir = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] config_source = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] control_exchange = openstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] debug = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] default_availability_zone = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] default_group_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] default_volume_type = QuobyteHD {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] disk_geometry = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] driver_client_cert = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] driver_client_cert_key = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] driver_data_namespace = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] driver_ssl_cert_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] driver_ssl_cert_verify = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] driver_use_ssl = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] enable_new_services = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] enable_unsupported_driver = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] enabled_backends = ['QuobyteHD'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] enforce_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] filter_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_api_insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_api_ssl_compression = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_ca_certificates_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_catalog_info = image:glance:publicURL {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_num_retries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance_request_timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] goodness_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] graceful_shutdown_timeout = 5 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] group_api_class = cinder.group.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] host = devstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_compress_on_upload = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_conversion_address_space_limit = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_conversion_cpu_limit = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_conversion_disable = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_introspection_address_space_limit = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_introspection_cpu_limit = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_upload_use_cinder_backend = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_upload_use_internal_tenant = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_volume_cache_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_volume_cache_max_count = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] image_volume_cache_max_size_gb = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] init_host_max_objects_retrieval = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] instance_format = [instance: %(uuid)s] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] iscsi_target_flags = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] iscsi_write_cache = on {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] iser_helper = tgtadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] iser_ip_address = 192.168.122.178 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] iser_port = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_color = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_config_append = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_dir = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_options = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_rotate_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_rotate_interval_type = days {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] log_rotation_type = none {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] max_age = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] max_logfile_count = 30 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] max_logfile_size_mb = 200 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] max_over_subscription_ratio = 20.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] message_reap_interval = 86400 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] message_ttl = 2592000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] migration_create_volume_timeout_secs = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] monkey_patch = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] monkey_patch_modules = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] my_ip = 192.168.122.178 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] no_snapshot_gb_quota = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] num_iser_scan_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] num_shell_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] num_volume_device_scan_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] nvmeof_conn_info_version = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] nvmet_ns_id = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] nvmet_port_id = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_max_limit = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_volume_ext_list = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_volume_listen_port = 8776 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_volume_use_ssl = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] osapi_volume_workers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] per_volume_size_limit = -1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] periodic_fuzzy_delay = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] periodic_interval = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] public_endpoint = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] publish_errors = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_backup_gigabytes = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_backups = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_gigabytes = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_groups = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_snapshots = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] quota_volumes = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] rate_limit_burst = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] rate_limit_except_level = CRITICAL {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] rate_limit_interval = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] reinit_driver_count = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] replication_device = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] report_discard_supported = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] report_interval = 120 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86628) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] reservation_clean_interval = 86400 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] reservation_expire = 86400 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] reserved_image_namespaces = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] reserved_percentage = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] rpc_response_timeout = 120 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] run_external_periodic_tasks = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] scst_target_driver = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] scst_target_iqn_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_down_time = 720 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] shell_completion = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] snapshot_name_template = snapshot-%s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] split_loggers = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] state_path = /opt/stack/data/cinder {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] storage_availability_zone = nova {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] storage_protocol = iSCSI {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] syslog_log_facility = LOG_USER {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] target_helper = lioadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] target_ip_address = 192.168.122.178 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] target_port = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] target_protocol = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] target_secondary_ip_addresses = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] trace_flags = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] transport_url = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] until_refresh = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_chap_auth = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_default_quota_class = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_journal = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_json = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_stderr = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] use_syslog = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] verify_glance_signatures = enabled {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_api_class = cinder.volume.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_backend_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_clear = zero {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_clear_ionice = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_clear_size = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_copy_bps_limit = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_dd_blocksize = 1M {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_name_template = volume-%s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_service_inithost_offload = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volume_usage_audit_period = month {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] zoning_mode = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_concurrency.disable_process_locking = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.auth_section = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.auth_type = password {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.auth_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.cache = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.include_service_catalog = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.interface = public {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcache_username = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.region_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.service_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.backend = dogpile.cache.null {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.backend_argument = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.backend_expiration_time = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.config_prefix = cache.oslo {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.debug_cache_backend = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.enable_retry_client = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.enable_socket_keepalive = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.expiration_time = 600 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.hashclient_retry_attempts = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_dead_retry = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_pool_maxsize = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_sasl_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.proxies = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.redis_db = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.redis_server = localhost:6379 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.retry_attempts = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.retry_delay = 0.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.socket_keepalive_count = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.socket_keepalive_idle = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.socket_keepalive_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.socket_timeout = 1.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.tls_allowed_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.tls_cafile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.tls_certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.tls_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.tls_keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cache.username = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] coordination.backend_url = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.asyncio_connection = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.asyncio_slave_connection = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.backend = sqlalchemy {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.connection = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.connection_debug = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.connection_parameters = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.connection_recycle_time = 3600 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.connection_trace = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.db_inc_retry_interval = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.db_max_retries = 20 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.db_max_retry_interval = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.db_retry_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.max_overflow = 50 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.max_pool_size = 5 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.max_retries = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.mysql_wsrep_sync_wait = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.pool_timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.retry_interval = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.slave_connection = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.sqlite_synchronous = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.synchronous_reader = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] database.use_db_reconnect = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_tracing.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.connection_string = messaging:// {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.es_doc_type = notification {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.es_scroll_size = 10000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.es_scroll_time = 2m {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.filter_error_trace = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.hmac_keys = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.sentinel_service_name = mymaster {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.socket_timeout = 0.1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.trace_requests = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler.trace_sqlalchemy = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler_jaeger.process_tags = {} {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler_jaeger.service_name_prefix = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] profiler_otlp.service_name_prefix = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.enforce_new_defaults = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.policy_default_rule = default {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86628) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.policy_file = policy.yaml {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Running cmd (subprocess): mount.quobyte {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.group = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.helper_command = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] privsep_osbrick.user = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.group = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.helper_command = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] cinder_sys_admin.user = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.auth_section = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.auth_type = password {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.cafile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.collect_timing = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.send_service_user_token = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.split_loggers = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.tls_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] service_user.tls_min_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.auth_section = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.auth_type = password {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.collect_timing = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.region_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.split_loggers = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.tls_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] glance.tls_min_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.backend_availability_zone = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.chap_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.chap_username = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.disk_geometry = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.driver_client_cert = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.driver_client_cert_key = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.driver_data_namespace = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.driver_use_ssl = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.extra_capabilities = {} {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.filter_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.goodness_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.iscsi_target_flags = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.iscsi_write_cache = on {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.iser_helper = tgtadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.iser_port = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_host = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_login = admin {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_mount_options = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_private_key = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_share_path = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.num_shell_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack quobyte-client[86638]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 15:53:42 devstack quobyte-client[86638]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.quobyte_volume_url = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.replication_device = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.report_discard_supported = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.reserved_percentage = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.target_helper = tgtadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.target_port = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.target_protocol = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.trace_flags = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.unique_fqdn_network = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.use_chap_auth = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_backend_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_clear = zero {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_clear_ionice = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_clear_size = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_reports.file_event_handler = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_reports.log_dir = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.backend_availability_zone = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.backend_host = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.chap_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.chap_username = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.chiscsi_conf = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.disk_geometry = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.driver_client_cert = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.driver_data_namespace = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.driver_use_ssl = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.extra_capabilities = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.filter_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.goodness_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.iser_helper = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.iser_ip_address = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.iser_port = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.iser_target_prefix = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_host = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_login = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_mount_options = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_private_key = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_share_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_ssh_port = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.num_shell_tries = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:42 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.nvmet_port_id = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.replication_device = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.report_discard_supported = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.reserved_percentage = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.scst_target_driver = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.storage_protocol = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.target_helper = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.target_ip_address = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.target_port = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.target_prefix = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.target_protocol = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.trace_flags = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.use_chap_auth = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_clear = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_clear_size = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] QuobyteHD.volumes_dir = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_notifications.driver = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_notifications.retry = -1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] key_manager.fixed_key = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.barbican_api_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.barbican_endpoint = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.barbican_endpoint_type = public {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.barbican_region_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.cafile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.collect_timing = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.number_of_retries = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.retry_delay = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.send_service_user_token = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.split_loggers = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.tls_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.tls_min_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.verify_ssl = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican.verify_ssl_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.auth_section = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.auth_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.cafile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.collect_timing = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.split_loggers = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.tls_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] barbican_service_user.tls_min_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.approle_role_id = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.approle_secret_id = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.auth_method = approle {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.auth_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.kv_mountpoint = secret {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.kv_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.kv_version = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.namespace = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.root_token_id = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.ssl_ca_crt_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.timeout = 60.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.token_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.token_role = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.use_ssl = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:53:42 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-3d87c1da-893c-4d5b-bf65-49ac551ca007 None None] ******************************************************************************** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:53:42 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.255s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:42 devstack cinder-volume[86628]: INFO cinder.volume.driver [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG cinder.volume.driver [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1803398132324, 'free_capacity_gb': 1775.1803398132324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86628) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG oslo_db.sqlalchemy.engines [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:53:42 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writer thread running {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.db.api [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Building query based on filter {{(pid=86628) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86628) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:43 devstack cinder-volume[86628]: INFO cinder.keymgr.migration [None req-999a3186-3775-482f-ac63-35ba9734298a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:53:43 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:43 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:43 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.243s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:53:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Driver initialization completed successfully. Sep 28 15:53:43 devstack cinder-volume[86628]: INFO cinder.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Initiating service 3 cleanup Sep 28 15:53:43 devstack cinder-volume[86628]: INFO cinder.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Service 3 cleanup completed. Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.service [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Creating RPC server for service cinder-volume {{(pid=86628) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.service [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86628) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:53:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:53:43 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:53:43 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:53:43 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Sep 28 15:53:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.259s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:53:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7a21afe4-66f4-4921-b06f-66c5dbeff00d None None] Driver post RPC initialization completed successfully. Sep 28 15:53:52 devstack cinder-volume[86342]: DEBUG dbcounter [-] [86342] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:53:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:54:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:54:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 6 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:54:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Flow 'volume_create_manager' (f8daca12-c771-425c-9c4c-6b29b81a3eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f729d7d0-7fa8-4cbd-8d09-e8a0176d720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f729d7d0-7fa8-4cbd-8d09-e8a0176d720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1316595689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b621380-eb5c-4be5-a1a3-e02c1fe66989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5e870c5a2046ec868d6f43b39f8145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:54:41Z,use_quota=True,user_id='c55b3e3ac0b8449f941f9d2339aba17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e546c2eb-dc11-44af-becd-8e308a869974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e546c2eb-dc11-44af-becd-8e308a869974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c431df1-0f1b-44e2-821d-9a235ddc7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c431df1-0f1b-44e2-821d-9a235ddc7802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b621380-eb5c-4be5-a1a3-e02c1fe66989', 'volume_name': 'volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf94dbf-8ad1-4ecc-9ab4-5e0af4ee93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf94dbf-8ad1-4ecc-9ab4-5e0af4ee93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12c2b0b-db97-4f9d-a805-63f3e99108d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:54:41 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Volume 1b621380-eb5c-4be5-a1a3-e02c1fe66989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989', 'volume_size': 1} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1316595689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b621380-eb5c-4be5-a1a3-e02c1fe66989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5e870c5a2046ec868d6f43b39f8145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:54:41Z,use_quota=True,user_id='c55b3e3ac0b8449f941f9d2339aba17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Creating volume 1b621380-eb5c-4be5-a1a3-e02c1fe66989 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:54:41 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:54:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:54:41 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 1073741824 Sep 28 15:54:41 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:54:42 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 1073741824" returned: 0 in 0.631s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:54:42 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 Sep 28 15:54:42 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:54:42 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989" returned: 0 in 0.306s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12c2b0b-db97-4f9d-a805-63f3e99108d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b716ea0-4cd7-4fe6-81e3-e6299dfa8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:54:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Volume volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 (1b621380-eb5c-4be5-a1a3-e02c1fe66989): created successfully Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b716ea0-4cd7-4fe6-81e3-e6299dfa8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:54:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Flow 'volume_create_manager' (f8daca12-c771-425c-9c4c-6b29b81a3eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:54:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6fa9ca15-01cd-4c1e-aa96-f1e0b0b52f0d tempest-TaggedAttachmentsTest-324993357 None] Created volume successfully. Sep 28 15:54:52 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:54:52 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Flow 'volume_create_manager' (828e1829-c689-4b49-b1ae-f1369c6625cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ae1f26-43fc-4abd-90d9-364b2f876358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ae1f26-43fc-4abd-90d9-364b2f876358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1154617710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6249dad9-6db1-4cf3-927e-72eafb86f03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50500160590846da8a57ddd7dc9da830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:55:25Z,use_quota=True,user_id='b2a2c916b5b645e68dd4ddfafa8bf905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c1f62-67b4-4f4f-b9f0-901e7e0b4b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c1f62-67b4-4f4f-b9f0-901e7e0b4b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccee484-7b53-4d10-8618-e6fa6d6e27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccee484-7b53-4d10-8618-e6fa6d6e27ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6249dad9-6db1-4cf3-927e-72eafb86f03f', 'volume_name': 'volume-6249dad9-6db1-4cf3-927e-72eafb86f03f', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a58b456-0399-4af5-b51a-86b14dff1550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a58b456-0399-4af5-b51a-86b14dff1550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c7326f-b97e-47f8-a060-cc5d149582cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:25 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Volume 6249dad9-6db1-4cf3-927e-72eafb86f03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6249dad9-6db1-4cf3-927e-72eafb86f03f', 'volume_size': 1} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1154617710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6249dad9-6db1-4cf3-927e-72eafb86f03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50500160590846da8a57ddd7dc9da830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:55:25Z,use_quota=True,user_id='b2a2c916b5b645e68dd4ddfafa8bf905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Creating volume 6249dad9-6db1-4cf3-927e-72eafb86f03f {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:55:25 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:55:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:25 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f 1073741824 Sep 28 15:55:25 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:26 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f 1073741824" returned: 0 in 0.798s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:26 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f Sep 28 15:55:26 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:26 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:55:26 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:27 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f" returned: 0 in 0.546s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c7326f-b97e-47f8-a060-cc5d149582cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6249dad9-6db1-4cf3-927e-72eafb86f03f', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520e0399-34d8-49cd-b3a3-0649c93dafd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:27 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Volume volume-6249dad9-6db1-4cf3-927e-72eafb86f03f (6249dad9-6db1-4cf3-927e-72eafb86f03f): created successfully Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520e0399-34d8-49cd-b3a3-0649c93dafd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Flow 'volume_create_manager' (828e1829-c689-4b49-b1ae-f1369c6625cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:55:27 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-88481150-fe85-4064-9ed7-02a610491cbe tempest-VolumesAdminNegativeTest-856287379 None] Created volume successfully. Sep 28 15:55:27 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.498s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 6 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:55:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:55:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Acquiring lock "cinder-6249dad9-6db1-4cf3-927e-72eafb86f03f-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:55:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Lock "cinder-6249dad9-6db1-4cf3-927e-72eafb86f03f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:55:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Acquiring lock "cinder-quobyte-6249dad9-6db1-4cf3-927e-72eafb86f03f" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:55:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Lock "cinder-quobyte-6249dad9-6db1-4cf3-927e-72eafb86f03f" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:55:28 devstack cinder-volume[86628]: INFO oslo.privsep.daemon [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu5ocmb69/privsep.sock'] Sep 28 15:55:28 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu5ocmb69/privsep.sock Sep 28 15:55:28 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:55:29 devstack cinder-volume[86628]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 15:55:29 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:29 devstack cinder-volume[86628]: INFO oslo.privsep.daemon [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Spawned new privsep daemon via rootwrap Sep 28 15:55:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Accepted privsep connection to /tmp/tmpu5ocmb69/privsep.sock {{(pid=86628) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 15:55:29 devstack cinder-volume[86628]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 15:55:29 devstack cinder-volume[86628]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 15:55:29 devstack cinder-volume[86628]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 15:55:29 devstack cinder-volume[86628]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88289 Sep 28 15:55:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f28b8ce-3f8b-4488-ac0b-65ece8769de9]: (2,) {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:55:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1998bba2-7e74-48a0-94fd-3aa5d53dc243]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:55:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:30 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f Sep 28 15:55:30 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:30 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:30 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f Sep 28 15:55:30 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:30 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6249dad9-6db1-4cf3-927e-72eafb86f03f" returned: 0 in 0.473s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Lock "cinder-quobyte-6249dad9-6db1-4cf3-927e-72eafb86f03f" released by "delete_volume" :: held 2.611s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:55:31 devstack cinder-volume[86628]: WARNING cinder.quota [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:55:31 devstack cinder-volume[86628]: WARNING cinder.quota [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Created reservations ['747faff4-43c5-44ba-ae43-8c42f72790fa', '2a726ae6-b30d-4d2b-bf46-44bdb39da7b2', '1bb2d6b8-83e8-46d4-b4fc-579f38b0fc65', '5f0108d4-ff5b-4bf4-ab95-1fa23129798b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:31 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:55:31 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:31 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.537s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:31 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:55:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Deleted volume successfully. Sep 28 15:55:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7c8b64ac-92f4-404b-8a3b-ab440a827c7e tempest-VolumesAdminNegativeTest-856287379 None] Lock "cinder-6249dad9-6db1-4cf3-927e-72eafb86f03f-delete_volume" released by "delete_volume" :: held 3.723s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Flow 'volume_create_manager' (96d327c7-02d6-43f1-8253-ae55b26e45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fa904d-b844-47d7-9fbf-11af615c611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fa904d-b844-47d7-9fbf-11af615c611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1264419399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb0ccd8-0735-4d3c-9603-dfbd2386d167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acab635611e64e3285a51c18fd6e0c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:55:37Z,use_quota=True,user_id='4ad8c1dcb57b4a1189aa1bd9c8070e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76c2624-97d4-44f4-9024-ab105875bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76c2624-97d4-44f4-9024-ab105875bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2227a1f0-d111-4f13-a19a-e7e5db8c5eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2227a1f0-d111-4f13-a19a-e7e5db8c5eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb0ccd8-0735-4d3c-9603-dfbd2386d167', 'volume_name': 'volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e87ada6-293d-43e1-a1e1-cf36470dfa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e87ada6-293d-43e1-a1e1-cf36470dfa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07534bd-35af-4c17-863a-2b37305044f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:36 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Volume 2fb0ccd8-0735-4d3c-9603-dfbd2386d167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167', 'volume_size': 1} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1264419399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb0ccd8-0735-4d3c-9603-dfbd2386d167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acab635611e64e3285a51c18fd6e0c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:55:37Z,use_quota=True,user_id='4ad8c1dcb57b4a1189aa1bd9c8070e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Creating volume 2fb0ccd8-0735-4d3c-9603-dfbd2386d167 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:55:36 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:55:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:37 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 1073741824 Sep 28 15:55:37 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:37 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 1073741824" returned: 0 in 0.731s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:37 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 Sep 28 15:55:37 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:55:38 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167" returned: 0 in 0.602s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07534bd-35af-4c17-863a-2b37305044f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cdcc6e-a2e5-4fd8-afab-957311e8b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:38 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Volume volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 (2fb0ccd8-0735-4d3c-9603-dfbd2386d167): created successfully Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cdcc6e-a2e5-4fd8-afab-957311e8b9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:38 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Flow 'volume_create_manager' (96d327c7-02d6-43f1-8253-ae55b26e45f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:55:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-85687cba-e2d1-47e4-b2cb-0b211fc1fb5e tempest-AttachVolumeShelveTestJSON-2097391742 None] Created volume successfully. Sep 28 15:55:51 devstack cinder-volume[86628]: WARNING py.warnings [req-4c42a294-40c0-4e49-a42e-fe262d41ae40 req-c82be67b-e62f-43ed-b49f-ceade101dfa2 tempest-AttachVolumeShelveTestJSON-2097391742 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 28 15:55:51 devstack cinder-volume[86628]: .first() Sep 28 15:55:51 devstack cinder-volume[86628]: Sep 28 15:55:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-4c42a294-40c0-4e49-a42e-fe262d41ae40 req-c82be67b-e62f-43ed-b49f-ceade101dfa2 tempest-AttachVolumeShelveTestJSON-2097391742 None] No connector for attachment ca4bbee9-fea4-4765-a5e3-e475c6eee4a7; skipping storage backend terminate_connection call. {{(pid=86628) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 15:55:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-4c42a294-40c0-4e49-a42e-fe262d41ae40 req-c82be67b-e62f-43ed-b49f-ceade101dfa2 tempest-AttachVolumeShelveTestJSON-2097391742 None] Deleting attachment ca4bbee9-fea4-4765-a5e3-e475c6eee4a7. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:55:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=9,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Flow 'volume_create_manager' (664cd472-b2ae-433d-8cc0-81f0fd46142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c1fae4-03af-453b-add5-e5b302675c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c1fae4-03af-453b-add5-e5b302675c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-986518968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ab3da7-e43a-4146-be54-251ac7aa459c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b373c39b8444e8bb7affd2eedb8b62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:55:59Z,use_quota=True,user_id='ffcd6beea3684e1a8720bdf63b0478de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a94cf5d-9609-4ecc-a405-ce2babe2cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a94cf5d-9609-4ecc-a405-ce2babe2cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ccc159-f81f-42fc-99fb-e769975dc125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ccc159-f81f-42fc-99fb-e769975dc125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ab3da7-e43a-4146-be54-251ac7aa459c', 'volume_name': 'volume-85ab3da7-e43a-4146-be54-251ac7aa459c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0128eaec-3620-4e8f-a246-7e85b0ec8710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0128eaec-3620-4e8f-a246-7e85b0ec8710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbb302b-f007-4c2c-a1b6-1007cd73b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:55:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Volume 85ab3da7-e43a-4146-be54-251ac7aa459c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ab3da7-e43a-4146-be54-251ac7aa459c', 'volume_size': 1} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-986518968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ab3da7-e43a-4146-be54-251ac7aa459c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b373c39b8444e8bb7affd2eedb8b62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:55:59Z,use_quota=True,user_id='ffcd6beea3684e1a8720bdf63b0478de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Creating volume 85ab3da7-e43a-4146-be54-251ac7aa459c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:55:59 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:55:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:55:59 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c 1073741824 Sep 28 15:55:59 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:00 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c 1073741824" returned: 0 in 0.854s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:00 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c Sep 28 15:56:00 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:01 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c" returned: 0 in 0.683s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbb302b-f007-4c2c-a1b6-1007cd73b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ab3da7-e43a-4146-be54-251ac7aa459c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043326f1-5a61-4060-a657-c57afc490e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:56:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Volume volume-85ab3da7-e43a-4146-be54-251ac7aa459c (85ab3da7-e43a-4146-be54-251ac7aa459c): created successfully Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043326f1-5a61-4060-a657-c57afc490e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:56:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Flow 'volume_create_manager' (664cd472-b2ae-433d-8cc0-81f0fd46142e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:56:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7da1b6b9-c965-49de-a82f-5785b0506f23 tempest-DeleteServersTestJSON-290020651 None] Created volume successfully. Sep 28 15:56:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-47a5c7e1-b064-4db3-9396-dda7ce3a334a req-a7f69603-c472-4e9e-a159-8684231b40d1 tempest-DeleteServersTestJSON-290020651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:56:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-47a5c7e1-b064-4db3-9396-dda7ce3a334a req-a7f69603-c472-4e9e-a159-8684231b40d1 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:56:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-47a5c7e1-b064-4db3-9396-dda7ce3a334a req-a7f69603-c472-4e9e-a159-8684231b40d1 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-47a5c7e1-b064-4db3-9396-dda7ce3a334a req-a7f69603-c472-4e9e-a159-8684231b40d1 tempest-DeleteServersTestJSON-290020651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-85ab3da7-e43a-4146-be54-251ac7aa459c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f653190-116e-4c08-8995-9f9dc6b58e9c', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:56:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-47a5c7e1-b064-4db3-9396-dda7ce3a334a req-a7f69603-c472-4e9e-a159-8684231b40d1 tempest-DeleteServersTestJSON-290020651 None] attachment_update completed successfully. Sep 28 15:56:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-b7929a04-063e-4076-9467-4f32e5d8b4c4 req-6d64fc1d-c938-4348-a3a8-71d6a2e09494 tempest-DeleteServersTestJSON-290020651 None] Terminate volume connection completed successfully. Sep 28 15:56:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-b7929a04-063e-4076-9467-4f32e5d8b4c4 req-6d64fc1d-c938-4348-a3a8-71d6a2e09494 tempest-DeleteServersTestJSON-290020651 None] Deleting attachment 2f653190-116e-4c08-8995-9f9dc6b58e9c. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:56:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-e1599028-178b-49b1-8e5c-d261e6228a0c req-55289c91-ae05-4147-b74b-ac6138397fa6 tempest-TaggedAttachmentsTest-324993357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:56:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-e1599028-178b-49b1-8e5c-d261e6228a0c req-55289c91-ae05-4147-b74b-ac6138397fa6 tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:56:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-e1599028-178b-49b1-8e5c-d261e6228a0c req-55289c91-ae05-4147-b74b-ac6138397fa6 tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-e1599028-178b-49b1-8e5c-d261e6228a0c req-55289c91-ae05-4147-b74b-ac6138397fa6 tempest-TaggedAttachmentsTest-324993357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ea574f1-858d-4d70-8961-cc10afdafd0e', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:56:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-e1599028-178b-49b1-8e5c-d261e6228a0c req-55289c91-ae05-4147-b74b-ac6138397fa6 tempest-TaggedAttachmentsTest-324993357 None] attachment_update completed successfully. Sep 28 15:56:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Acquiring lock "cinder-85ab3da7-e43a-4146-be54-251ac7aa459c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:56:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Lock "cinder-85ab3da7-e43a-4146-be54-251ac7aa459c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:56:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Acquiring lock "cinder-quobyte-85ab3da7-e43a-4146-be54-251ac7aa459c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:56:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Lock "cinder-quobyte-85ab3da7-e43a-4146-be54-251ac7aa459c" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:56:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1acd3ca-2e9e-4184-a8bd-28a9c3086017]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:56:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:18 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c Sep 28 15:56:18 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:18 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c" returned: 0 in 0.434s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:18 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c Sep 28 15:56:18 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:18 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-85ab3da7-e43a-4146-be54-251ac7aa459c" returned: 0 in 0.445s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Lock "cinder-quobyte-85ab3da7-e43a-4146-be54-251ac7aa459c" released by "delete_volume" :: held 0.943s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Created reservations ['7e6b97a8-516c-4334-97fb-14feac2f3fb7', 'e05cbbb5-19c0-45ab-b40d-ea821ecf69a5', '752b51b3-a19a-4133-8242-25f17bcb5a28', 'dbffdfa7-670b-4427-9086-e964c6a36c61'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:19 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:56:19 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:19 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.504s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:56:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Deleted volume successfully. Sep 28 15:56:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e23bfc0d-199a-4e92-b60e-f7c491246e51 tempest-DeleteServersTestJSON-290020651 None] Lock "cinder-85ab3da7-e43a-4146-be54-251ac7aa459c-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:56:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-557a3bb5-7148-4181-9f41-36fb1d7135bb req-95a16d25-ea3b-46a7-8ea3-b72992ce7e39 tempest-TaggedAttachmentsTest-324993357 None] Terminate volume connection completed successfully. Sep 28 15:56:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-557a3bb5-7148-4181-9f41-36fb1d7135bb req-95a16d25-ea3b-46a7-8ea3-b72992ce7e39 tempest-TaggedAttachmentsTest-324993357 None] Deleting attachment 8ea574f1-858d-4d70-8961-cc10afdafd0e. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:26 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:56:26 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:27 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.336s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:56:29 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=34,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=4 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:30 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=22,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Acquiring lock "cinder-1b621380-eb5c-4be5-a1a3-e02c1fe66989-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Lock "cinder-1b621380-eb5c-4be5-a1a3-e02c1fe66989-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Acquiring lock "cinder-quobyte-1b621380-eb5c-4be5-a1a3-e02c1fe66989" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Lock "cinder-quobyte-1b621380-eb5c-4be5-a1a3-e02c1fe66989" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c303a-7780-448e-891f-0b92a326a7d4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:37 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 Sep 28 15:56:37 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:37 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989" returned: 0 in 0.489s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:37 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989 Sep 28 15:56:37 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:38 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1b621380-eb5c-4be5-a1a3-e02c1fe66989" returned: 0 in 0.739s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Lock "cinder-quobyte-1b621380-eb5c-4be5-a1a3-e02c1fe66989" released by "delete_volume" :: held 1.295s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Created reservations ['69c481fc-a8d8-4746-9ff9-885b7c07ed2f', '0993e2b9-cb4f-4a74-b773-603db770603d', 'af5b9425-ae95-4e06-87b1-efa05ec0ca43', 'f538d840-df37-4275-ab18-d2a37b34b7e2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:38 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:56:38 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:39 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.533s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:39 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:56:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Deleted volume successfully. Sep 28 15:56:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-40441bdc-9ce4-4bc7-a5cc-2f32727bd83e tempest-TaggedAttachmentsTest-324993357 None] Lock "cinder-1b621380-eb5c-4be5-a1a3-e02c1fe66989-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:56:48 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:49 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Acquiring lock "cinder-2fb0ccd8-0735-4d3c-9603-dfbd2386d167-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:56:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "cinder-2fb0ccd8-0735-4d3c-9603-dfbd2386d167-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:56:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Acquiring lock "cinder-quobyte-2fb0ccd8-0735-4d3c-9603-dfbd2386d167" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:56:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "cinder-quobyte-2fb0ccd8-0735-4d3c-9603-dfbd2386d167" acquired by "delete_volume" :: waited 0.069s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:56:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cd12e2-2bbe-4102-a8b6-b0ba8f68e700]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:56:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:51 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 Sep 28 15:56:51 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:51 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167" returned: 0 in 0.930s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:51 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167 Sep 28 15:56:51 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:52 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2fb0ccd8-0735-4d3c-9603-dfbd2386d167" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "cinder-quobyte-2fb0ccd8-0735-4d3c-9603-dfbd2386d167" released by "delete_volume" :: held 1.688s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Created reservations ['c60805a2-e736-45fc-a4e2-ad5e78828df1', 'b9811b5e-055a-4fcc-a0ac-c669ca6c3d56', '17e1d7b2-5a2e-4c04-a546-a348005185c3', '89dda021-0596-4084-a3a6-7bdaac8b5e75'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:56:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:52 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:56:52 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:53 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.591s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:53 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:56:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Deleted volume successfully. Sep 28 15:56:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2dc81525-d9ee-429b-8a83-2e2dbe3d8c69 tempest-AttachVolumeShelveTestJSON-2097391742 None] Lock "cinder-2fb0ccd8-0735-4d3c-9603-dfbd2386d167-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:02 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:57:03 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Flow 'volume_create_manager' (364b6e59-8da1-4aef-83b6-e102a0f5e377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5ef4f1-19f2-4da5-9802-a2a27b66e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5ef4f1-19f2-4da5-9802-a2a27b66e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1154123527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb051f2-6c09-4ee0-8d13-c9450bc1e79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea302e6d474b1186ca26e9572c558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:09Z,use_quota=True,user_id='39286d066f8342ebb1dc863695de3b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e10120-3bf6-4084-b910-626d1f72ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e10120-3bf6-4084-b910-626d1f72ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0a0ff3-fe16-452c-b077-4f01ffc6c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0a0ff3-fe16-452c-b077-4f01ffc6c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb051f2-6c09-4ee0-8d13-c9450bc1e79a', 'volume_name': 'volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9900fc5-fc5f-416b-a292-6d611fa98c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9900fc5-fc5f-416b-a292-6d611fa98c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b3322-e92d-482e-bec6-3a36a6e5b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:09 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Volume 1fb051f2-6c09-4ee0-8d13-c9450bc1e79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a', 'volume_size': 1} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1154123527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb051f2-6c09-4ee0-8d13-c9450bc1e79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ea302e6d474b1186ca26e9572c558a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:09Z,use_quota=True,user_id='39286d066f8342ebb1dc863695de3b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Creating volume 1fb051f2-6c09-4ee0-8d13-c9450bc1e79a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:57:09 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:57:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:09 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a 1073741824 Sep 28 15:57:09 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:10 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a 1073741824" returned: 0 in 1.014s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:10 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a Sep 28 15:57:10 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:11 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a" returned: 0 in 0.524s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b3322-e92d-482e-bec6-3a36a6e5b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dce8d9-29ab-438a-9a55-ea219507712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Volume volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a (1fb051f2-6c09-4ee0-8d13-c9450bc1e79a): created successfully Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dce8d9-29ab-438a-9a55-ea219507712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Flow 'volume_create_manager' (364b6e59-8da1-4aef-83b6-e102a0f5e377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:11 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-35b15ecd-671a-4b9f-8b23-2dddd1748d52 tempest-ServerRescueNegativeTestJSON-1656581911 None] Created volume successfully. Sep 28 15:57:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6b53e721-d3da-4d87-96ec-1ea49eb09d90 tempest-GroupSnapshotsTest-2081199139 None] Group tempest-GroupSnapshotsTest-Group-1813255853: creating Sep 28 15:57:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6b53e721-d3da-4d87-96ec-1ea49eb09d90 tempest-GroupSnapshotsTest-2081199139 None] Group tempest-GroupSnapshotsTest-Group-1813255853: created successfully Sep 28 15:57:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6b53e721-d3da-4d87-96ec-1ea49eb09d90 tempest-GroupSnapshotsTest-2081199139 None] Create group completed successfully. Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (e8e47eeb-d7d3-4bb6-8ec7-b26ea71e7eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67b1fee-a595-4d68-b7eb-eafa6bc87d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67b1fee-a595-4d68-b7eb-eafa6bc87d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2074482578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81955d59-7779-44b0-a96b-c1f1787ae034,host='devstack@QuobyteHD#QuobyteHD',id=69bd2b2c-9168-4379-b518-97ef3ed21be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:15Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6fb3741-ae25-433b-abf0-0860374a031a),volume_type_id=b6fb3741-ae25-433b-abf0-0860374a031a)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706d195-f499-4d05-abdb-046dc678903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706d195-f499-4d05-abdb-046dc678903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54e26cb-91aa-452a-934a-b66e22f134d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54e26cb-91aa-452a-934a-b66e22f134d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69bd2b2c-9168-4379-b518-97ef3ed21be5', 'volume_name': 'volume-69bd2b2c-9168-4379-b518-97ef3ed21be5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab7afc4-9fdc-4844-b387-80ab26a39f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab7afc4-9fdc-4844-b387-80ab26a39f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24734da0-04b2-4011-9bc0-dbd1577ae39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:14 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Volume 69bd2b2c-9168-4379-b518-97ef3ed21be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69bd2b2c-9168-4379-b518-97ef3ed21be5', 'volume_size': 1} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81955d59-7779-44b0-a96b-c1f1787ae034,created_at=2026-09-28T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2074482578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81955d59-7779-44b0-a96b-c1f1787ae034,host='devstack@QuobyteHD#QuobyteHD',id=69bd2b2c-9168-4379-b518-97ef3ed21be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:15Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6fb3741-ae25-433b-abf0-0860374a031a),volume_type_id=b6fb3741-ae25-433b-abf0-0860374a031a)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Creating volume 69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:57:14 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:57:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:15 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 1073741824 Sep 28 15:57:15 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:15 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 1073741824" returned: 0 in 0.752s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:15 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 Sep 28 15:57:15 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:16 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5" returned: 0 in 0.404s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24734da0-04b2-4011-9bc0-dbd1577ae39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69bd2b2c-9168-4379-b518-97ef3ed21be5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8da55c3-df51-4116-87ed-9d095ecceb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Volume volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 (69bd2b2c-9168-4379-b518-97ef3ed21be5): created successfully Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8da55c3-df51-4116-87ed-9d095ecceb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (e8e47eeb-d7d3-4bb6-8ec7-b26ea71e7eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-87bbcd2f-c3ca-47d7-aff3-068999ac3440 tempest-GroupSnapshotsTest-2081199139 None] Created volume successfully. Sep 28 15:57:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] GroupSnapshot 66f92aa5-13ca-4641-bd7b-35dd633e0d15: creating. Sep 28 15:57:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Group snapshot 66f92aa5-13ca-4641-bd7b-35dd633e0d15: creating. {{(pid=86628) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:57:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Creating offline snapshot d5fccb0f-b01f-4f9d-a635-c86252f3537e of volume 69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:57:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[40209988-fe5b-49a9-9798-6ac7f5c89d70]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:18 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 Sep 28 15:57:18 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:19 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5" returned: 0 in 1.020s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:19 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e 1G Sep 28 15:57:19 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e 1G" returned: 0 in 1.153s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:20 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:20 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e Sep 28 15:57:20 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:21 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e" returned: 0 in 1.086s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:21 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:57:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:21 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e Sep 28 15:57:21 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:22 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e" returned: 0 in 0.708s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:22 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info Sep 28 15:57:22 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:23 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:23 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:57:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:23 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info Sep 28 15:57:23 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:23 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.info" returned: 0 in 0.545s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.273s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a6f9a225-621a-4352-b7ae-dccfb0b8fbdb tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 66f92aa5-13ca-4641-bd7b-35dd633e0d15: created successfully Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-d5fccb0f-b01f-4f9d-a635-c86252f3537e-53012b7b-64ae-4e9c-be2e-5a8918471bc4" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-d5fccb0f-b01f-4f9d-a635-c86252f3537e-53012b7b-64ae-4e9c-be2e-5a8918471bc4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Creating volume 53012b7b-64ae-4e9c-be2e-5a8918471bc4 from snapshot d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-53012b7b-64ae-4e9c-be2e-5a8918471bc4" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-53012b7b-64ae-4e9c-be2e-5a8918471bc4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] snapshot: d5fccb0f-b01f-4f9d-a635-c86252f3537e, volume: 53012b7b-64ae-4e9c-be2e-5a8918471bc4, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[34996cba-cdfb-4529-9156-f42619d782d6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:25 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e Sep 28 15:57:25 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:26 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e" returned: 0 in 1.080s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69bd2b2c-9168-4379-b518-97ef3ed21be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:57:26 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:57:26 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[54988c01-cc71-4561-8e20-96824d64fb30]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:27 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 Sep 28 15:57:27 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:27 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.865s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 8 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:57:27 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5" returned: 0 in 1.027s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:57:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:27 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 Sep 28 15:57:27 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:35 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:57:35 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=9,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:57:42 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4" returned: 0 in 14.273s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5, size 1024.00 MB, duration 14.28 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:57:42 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Converted 1024.00 MB image at 71.73 MB/s Sep 28 15:57:42 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:42 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 Sep 28 15:57:42 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:42 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4" returned: 0 in 0.603s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-53012b7b-64ae-4e9c-be2e-5a8918471bc4" released by "_copy_volume_from_snapshot" :: held 17.336s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Flow 'volume_create_manager' (677d14d4-57a6-4a21-b315-318874df31f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247ab03b-7a83-4be4-a711-413475f66d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247ab03b-7a83-4be4-a711-413475f66d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1788110935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5da6c06-7c5a-4575-8b3d-c17db2b57abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85358702b747489fbf6fb625b711c29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:43Z,use_quota=True,user_id='b398db3ba72f49d2bce82608d7b1bae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf27c7e-4299-4e2b-ab3c-9384a541488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf27c7e-4299-4e2b-ab3c-9384a541488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb08d61d-6624-47a9-ad31-8d9f55bc08a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb08d61d-6624-47a9-ad31-8d9f55bc08a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5da6c06-7c5a-4575-8b3d-c17db2b57abc', 'volume_name': 'volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d3ec9a-7766-4041-8cf0-5ab0092c4064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d3ec9a-7766-4041-8cf0-5ab0092c4064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d531d5c-9a35-4154-87f6-83ff18b1b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Volume b5da6c06-7c5a-4575-8b3d-c17db2b57abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc', 'volume_size': 1} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-d5fccb0f-b01f-4f9d-a635-c86252f3537e-53012b7b-64ae-4e9c-be2e-5a8918471bc4" released by "_create_volume_from_snapshot" :: held 17.548s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.567s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1788110935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5da6c06-7c5a-4575-8b3d-c17db2b57abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85358702b747489fbf6fb625b711c29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:43Z,use_quota=True,user_id='b398db3ba72f49d2bce82608d7b1bae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Creating volume b5da6c06-7c5a-4575-8b3d-c17db2b57abc {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:57:42 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:57:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Acquiring lock "cinder-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "cinder-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:43 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc 1073741824 Sep 28 15:57:43 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Acquiring lock "cinder-quobyte-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "cinder-quobyte-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:43 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265a2f5-6739-42b4-b4b7-2b77f3e4797e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b69726ad-28a2-4513-af5c-7093187955db tempest-GroupSnapshotsTest-2081199139 None] Create group from source-snapshot-66f92aa5-13ca-4641-bd7b-35dd633e0d15 completed successfully. Sep 28 15:57:43 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a Sep 28 15:57:43 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:44 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a" returned: 0 in 1.012s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:44 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a Sep 28 15:57:44 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:44 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc 1073741824" returned: 0 in 1.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:44 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc Sep 28 15:57:44 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-53012b7b-64ae-4e9c-be2e-5a8918471bc4" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-53012b7b-64ae-4e9c-be2e-5a8918471bc4" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70271a-891a-4846-a1d6-89bda557e94d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:45 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a" returned: 0 in 0.835s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "cinder-quobyte-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a" released by "delete_volume" :: held 2.005s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:45 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc" returned: 0 in 0.729s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] <== create_volume: return (2274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:45 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 Sep 28 15:57:45 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d531d5c-9a35-4154-87f6-83ff18b1b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd0ac8e-887b-4299-adfb-e3217a6da4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:45 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Volume volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc (b5da6c06-7c5a-4575-8b3d-c17db2b57abc): created successfully Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd0ac8e-887b-4299-adfb-e3217a6da4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Flow 'volume_create_manager' (677d14d4-57a6-4a21-b315-318874df31f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:45 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-49b8d215-65c3-42be-a460-aad26de5149c tempest-ServersNegativeTestJSON-1772217743 None] Created volume successfully. Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Created reservations ['a4e57b39-aa78-4111-a95c-c9961c61d755', '324d8152-ec26-4e37-b91a-46f00fe46922', '3777eaa2-61c3-4fba-8419-848548c49ca8', '1e31ba58-c976-4468-a606-0aab286144b4'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:45 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:57:45 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:45 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4" returned: 0 in 0.859s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:45 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4 Sep 28 15:57:45 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:46 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.507s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:46 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Deleted volume successfully. Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4db326fc-743c-4b1d-95fd-c38f0e94e053 tempest-ServerRescueNegativeTestJSON-1656581911 None] Lock "cinder-1fb051f2-6c09-4ee0-8d13-c9450bc1e79a-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:46 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-53012b7b-64ae-4e9c-be2e-5a8918471bc4" returned: 0 in 0.544s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-53012b7b-64ae-4e9c-be2e-5a8918471bc4" released by "delete_volume" :: held 1.537s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['c388ac5f-2fbf-4a46-a17c-1825acfd32e8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:46 devstack cinder-volume[86628]: WARNING cinder.quota [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-679312772 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-679312772, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:57:46 devstack cinder-volume[86628]: WARNING cinder.quota [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-679312772 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-679312772, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['2beaf0f3-b385-43dc-aa4d-61d182c9a74c', 'b5179c90-7407-476d-8b44-45deb3106d84', '2d573bcc-3bdc-4065-b79e-1b63ed067b09', 'db677ba8-ab1b-4306-ab5f-e343bba9ef65'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:46 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:57:46 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:47 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.387s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:47 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:47 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d9372cb7-47da-41ec-a22b-77f04d2f0881 tempest-GroupSnapshotsTest-2081199139 None] Delete group completed successfully. Sep 28 15:57:47 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 66f92aa5-13ca-4641-bd7b-35dd633e0d15: deleting Sep 28 15:57:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 66f92aa5-13ca-4641-bd7b-35dd633e0d15: deleting {{(pid=86628) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-69bd2b2c-9168-4379-b518-97ef3ed21be5" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-69bd2b2c-9168-4379-b518-97ef3ed21be5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-d5fccb0f-b01f-4f9d-a635-c86252f3537e" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-d5fccb0f-b01f-4f9d-a635-c86252f3537e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Deleting offline snapshot d5fccb0f-b01f-4f9d-a635-c86252f3537e of volume 69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] snapshot_file for this snap is: volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a791c571-a3c5-42e6-b062-10192f4b3ef8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:48 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e Sep 28 15:57:48 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:48 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e" returned: 0 in 0.687s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69bd2b2c-9168-4379-b518-97ef3ed21be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4feeea-fb7e-4dcd-9f7a-471e7abd5c74]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:49 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 Sep 28 15:57:49 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:49 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5" returned: 0 in 0.810s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:49 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e Sep 28 15:57:49 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:50 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e" returned: 0 in 0.619s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:50 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e Sep 28 15:57:50 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:50 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5.d5fccb0f-b01f-4f9d-a635-c86252f3537e" returned: 0 in 0.559s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-d5fccb0f-b01f-4f9d-a635-c86252f3537e" released by "_delete_snapshot" :: held 2.858s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-69bd2b2c-9168-4379-b518-97ef3ed21be5" released by "delete_snapshot" :: held 2.904s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:51 devstack cinder-volume[86628]: WARNING cinder.quota [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-679312772 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-679312772, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['6c1355b3-100b-4b59-a3c5-77a57f4b07b8', '064efa5e-78b6-46b1-b5ab-30c51604639d', '0049c04c-9f58-4e19-8a7c-a4f2a4d054d1', 'd9ffc9b6-1b1e-4876-8240-82b85786d1f8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Flow 'volume_create_manager' (af16b7f1-8703-4dec-b91f-bab484c58383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968e86c9-ba14-4221-9aff-a4fc02ce0f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968e86c9-ba14-4221-9aff-a4fc02ce0f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1145470585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5354c9b6-a9a3-4c88-877c-5a4d2b33b277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85358702b747489fbf6fb625b711c29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:51Z,use_quota=True,user_id='b398db3ba72f49d2bce82608d7b1bae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6805a2c0-3a9e-42ab-b5c2-ae21319a3c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6805a2c0-3a9e-42ab-b5c2-ae21319a3c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f72a5c7-38dc-4ad6-9f16-3949367f5a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f72a5c7-38dc-4ad6-9f16-3949367f5a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5354c9b6-a9a3-4c88-877c-5a4d2b33b277', 'volume_name': 'volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14516b8-3d38-4c69-898e-005d11480c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14516b8-3d38-4c69-898e-005d11480c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13b5148-0bf7-4436-9827-6c7d9d930c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:51 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Volume 5354c9b6-a9a3-4c88-877c-5a4d2b33b277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277', 'volume_size': 1} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1145470585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5354c9b6-a9a3-4c88-877c-5a4d2b33b277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85358702b747489fbf6fb625b711c29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:51Z,use_quota=True,user_id='b398db3ba72f49d2bce82608d7b1bae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Creating volume 5354c9b6-a9a3-4c88-877c-5a4d2b33b277 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:57:51 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:51 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 1073741824 Sep 28 15:57:51 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1a725206-d71c-4c86-b188-17e434680da0 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 66f92aa5-13ca-4641-bd7b-35dd633e0d15: deleted successfully Sep 28 15:57:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-69bd2b2c-9168-4379-b518-97ef3ed21be5" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-69bd2b2c-9168-4379-b518-97ef3ed21be5" acquired by "delete_volume" :: waited 0.043s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[97964197-a0ea-4abe-aee4-f23b930ea7ef]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:52 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 1073741824" returned: 0 in 0.831s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:52 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 Sep 28 15:57:52 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:52 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 Sep 28 15:57:52 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:52 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5" returned: 0 in 0.642s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:52 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277" returned: 0 in 0.551s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:52 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5 Sep 28 15:57:52 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13b5148-0bf7-4436-9827-6c7d9d930c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeceebb-5275-44c6-a6e1-068f47de11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:52 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Volume volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 (5354c9b6-a9a3-4c88-877c-5a4d2b33b277): created successfully Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeceebb-5275-44c6-a6e1-068f47de11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Flow 'volume_create_manager' (af16b7f1-8703-4dec-b91f-bab484c58383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:52 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b0e4ff1d-f982-4774-8be6-35d7e45cf53e tempest-ServersNegativeTestJSON-1772217743 None] Created volume successfully. Sep 28 15:57:53 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69bd2b2c-9168-4379-b518-97ef3ed21be5" returned: 0 in 0.760s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-69bd2b2c-9168-4379-b518-97ef3ed21be5" released by "delete_volume" :: held 1.511s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:53 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['6ebad20d-c813-468a-a858-ee97badd59c7'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:53 devstack cinder-volume[86628]: WARNING cinder.db.api [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-679312772'] Sep 28 15:57:53 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['1dc1f5df-684f-4e78-95d6-c78252433ff4', '6475c632-0e41-42ea-9ff6-4100c9c8177f', '4eb4037c-dc44-4783-98d8-1fdeeaaaa4b9', '14c99a63-3c16-4b3c-a262-a2bb73ce5361'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:54 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:57:54 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:54 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.398s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "cinder-5354c9b6-a9a3-4c88-877c-5a4d2b33b277-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2e14173c-8d76-4586-ac27-2eb80b031205 tempest-GroupSnapshotsTest-2081199139 None] Delete group completed successfully. Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-5354c9b6-a9a3-4c88-877c-5a4d2b33b277-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "cinder-quobyte-5354c9b6-a9a3-4c88-877c-5a4d2b33b277" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-quobyte-5354c9b6-a9a3-4c88-877c-5a4d2b33b277" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ecd183-eafa-4c44-a3bb-d0ce3c7f9dd3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:54 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 Sep 28 15:57:54 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:55 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277" returned: 0 in 0.588s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:55 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277 Sep 28 15:57:55 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e21b0892-8bbb-4ba9-914e-3ad424d5996d tempest-GroupSnapshotsTest-2081199139 None] Group tempest-GroupSnapshotsTest-Group-2137949639: creating Sep 28 15:57:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e21b0892-8bbb-4ba9-914e-3ad424d5996d tempest-GroupSnapshotsTest-2081199139 None] Group tempest-GroupSnapshotsTest-Group-2137949639: created successfully Sep 28 15:57:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e21b0892-8bbb-4ba9-914e-3ad424d5996d tempest-GroupSnapshotsTest-2081199139 None] Create group completed successfully. Sep 28 15:57:55 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5354c9b6-a9a3-4c88-877c-5a4d2b33b277" returned: 0 in 0.387s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-quobyte-5354c9b6-a9a3-4c88-877c-5a4d2b33b277" released by "delete_volume" :: held 1.076s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:55 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Created reservations ['392a1e8b-6553-4356-a41b-cfba4bcff25a', 'b31e9756-9265-4077-bcf5-5a147484dc0e', '8c81c67a-7ee9-4828-b3e0-a6bcc5f21da7', '2dc44e75-a36c-4651-ada1-034b696d1d27'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:56 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:57:56 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:56 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.424s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Deleted volume successfully. Sep 28 15:57:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-98a8aa5f-df45-4d9b-8f70-99383826c6df tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-5354c9b6-a9a3-4c88-877c-5a4d2b33b277-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "cinder-b5da6c06-7c5a-4575-8b3d-c17db2b57abc-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-b5da6c06-7c5a-4575-8b3d-c17db2b57abc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "cinder-quobyte-b5da6c06-7c5a-4575-8b3d-c17db2b57abc" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-quobyte-b5da6c06-7c5a-4575-8b3d-c17db2b57abc" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1f2e56-05c5-4921-9383-6eb091c010e4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:57 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc Sep 28 15:57:57 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (04ef1b40-126a-49eb-91b4-5439c56123b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8584f1b-d126-4302-b3fe-57f89a9e7c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8584f1b-d126-4302-b3fe-57f89a9e7c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1832199635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4774430-ef9b-4400-9798-2d8071f127f7,host='devstack@QuobyteHD#QuobyteHD',id=ddccdd59-48e4-45a5-85f0-bbdfa897599c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:58Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67ef5ec0-68b6-4178-a8ae-caf1fad734d4),volume_type_id=67ef5ec0-68b6-4178-a8ae-caf1fad734d4)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0f69e3-a74f-477f-9df2-ccdfd6cb2bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0f69e3-a74f-477f-9df2-ccdfd6cb2bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a3e14e-f547-4a11-bf26-389f80c4b4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a3e14e-f547-4a11-bf26-389f80c4b4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddccdd59-48e4-45a5-85f0-bbdfa897599c', 'volume_name': 'volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f017ca-a99b-405a-af61-b3221931d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f017ca-a99b-405a-af61-b3221931d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfdd3f7-f931-4c0a-858b-479aeb637a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Volume ddccdd59-48e4-45a5-85f0-bbdfa897599c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c', 'volume_size': 1} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a4774430-ef9b-4400-9798-2d8071f127f7,created_at=2026-09-28T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1832199635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4774430-ef9b-4400-9798-2d8071f127f7,host='devstack@QuobyteHD#QuobyteHD',id=ddccdd59-48e4-45a5-85f0-bbdfa897599c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:57:58Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67ef5ec0-68b6-4178-a8ae-caf1fad734d4),volume_type_id=67ef5ec0-68b6-4178-a8ae-caf1fad734d4)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Creating volume ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:57:57 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:57 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c 1073741824 Sep 28 15:57:57 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:57 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc" returned: 0 in 0.632s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:57 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc Sep 28 15:57:57 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:58 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b5da6c06-7c5a-4575-8b3d-c17db2b57abc" returned: 0 in 0.341s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-quobyte-b5da6c06-7c5a-4575-8b3d-c17db2b57abc" released by "delete_volume" :: held 1.068s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Created reservations ['1ef81817-a45b-417d-bd25-72439c0a7c79', '9147e3fd-f557-43fb-931b-889fde1b51e9', '31367060-90cb-4bbc-abf9-c76a50641504', 'e925daf8-864b-413b-a52f-bd20beb6d1a2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:58 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c 1073741824" returned: 0 in 0.658s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:58 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:57:58 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:57:58 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c Sep 28 15:57:58 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:57:58 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c" returned: 0 in 0.378s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfdd3f7-f931-4c0a-858b-479aeb637a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60403e9-4131-4c63-8d3f-a31810b93fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:57:59 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 28 15:57:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.499s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:57:59 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:57:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Volume volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c (ddccdd59-48e4-45a5-85f0-bbdfa897599c): created successfully Sep 28 15:57:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60403e9-4131-4c63-8d3f-a31810b93fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:57:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (04ef1b40-126a-49eb-91b4-5439c56123b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:57:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Deleted volume successfully. Sep 28 15:57:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8f5c5ced-beaa-421a-b0d1-20b342e02909 tempest-GroupSnapshotsTest-2081199139 None] Created volume successfully. Sep 28 15:57:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e63524e9-5228-469c-95a0-6efd5965e368 tempest-ServersNegativeTestJSON-1772217743 None] Lock "cinder-b5da6c06-7c5a-4575-8b3d-c17db2b57abc-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (40ffc463-d428-48e7-b5f9-2d838e0b2dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d279fcf-3214-47ac-beaf-b83536f7599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d279fcf-3214-47ac-beaf-b83536f7599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525188978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4774430-ef9b-4400-9798-2d8071f127f7,host='devstack@QuobyteHD#QuobyteHD',id=dfab6cad-d415-44cc-982c-02601c1c0286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:02Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67ef5ec0-68b6-4178-a8ae-caf1fad734d4),volume_type_id=67ef5ec0-68b6-4178-a8ae-caf1fad734d4)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29723db-fe8c-4571-a310-cbcc0d93207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29723db-fe8c-4571-a310-cbcc0d93207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9cf38b-b1ec-4c46-898b-56409706584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9cf38b-b1ec-4c46-898b-56409706584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfab6cad-d415-44cc-982c-02601c1c0286', 'volume_name': 'volume-dfab6cad-d415-44cc-982c-02601c1c0286', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bba4787-22b9-404b-a937-c737d5df640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bba4787-22b9-404b-a937-c737d5df640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d60a3b-eb12-4161-9009-d124c10b4e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Volume dfab6cad-d415-44cc-982c-02601c1c0286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfab6cad-d415-44cc-982c-02601c1c0286', 'volume_size': 1} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a4774430-ef9b-4400-9798-2d8071f127f7,created_at=2026-09-28T13:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525188978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4774430-ef9b-4400-9798-2d8071f127f7,host='devstack@QuobyteHD#QuobyteHD',id=dfab6cad-d415-44cc-982c-02601c1c0286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:02Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67ef5ec0-68b6-4178-a8ae-caf1fad734d4),volume_type_id=67ef5ec0-68b6-4178-a8ae-caf1fad734d4)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Creating volume dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:01 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:01 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 1073741824 Sep 28 15:58:01 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:02 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 1073741824" returned: 0 in 0.783s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:02 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 Sep 28 15:58:02 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:02 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286" returned: 0 in 0.299s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d60a3b-eb12-4161-9009-d124c10b4e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfab6cad-d415-44cc-982c-02601c1c0286', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fedf78-1970-43b4-89f2-25458f7bd39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Volume volume-dfab6cad-d415-44cc-982c-02601c1c0286 (dfab6cad-d415-44cc-982c-02601c1c0286): created successfully Sep 28 15:58:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fedf78-1970-43b4-89f2-25458f7bd39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (40ffc463-d428-48e7-b5f9-2d838e0b2dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:03 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1b32f0d4-63bd-471a-9865-bf5e1bccffa3 tempest-GroupSnapshotsTest-2081199139 None] Created volume successfully. Sep 28 15:58:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-29265ad2-454d-46c5-8135-32f4decadcf1 tempest-GroupSnapshotsTest-2081199139 None] Update group completed successfully. Sep 28 15:58:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-710360f5-3093-4d2d-a2cd-ea54b611859d tempest-GroupSnapshotsTest-2081199139 None] Update group completed successfully. Sep 28 15:58:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-853be68d-f875-4a03-b50c-6ac3ea4d3dfb tempest-GroupSnapshotsTest-2081199139 None] Update group completed successfully. Sep 28 15:58:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-04b9e2d9-8132-401b-b1c2-fca776f95c35 tempest-GroupSnapshotsTest-2081199139 None] Update group completed successfully. Sep 28 15:58:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] GroupSnapshot 48149c08-55e2-47e5-9d51-5eb1749fe166: creating. Sep 28 15:58:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Group snapshot 48149c08-55e2-47e5-9d51-5eb1749fe166: creating. {{(pid=86628) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:58:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Creating offline snapshot 0520a7ab-d137-4722-9d22-b2a40daba0bf of volume ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:58:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a8296-08a6-4a57-8601-1f9c46c5674d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:10 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c Sep 28 15:58:10 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:11 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c" returned: 0 in 0.546s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:11 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf 1G Sep 28 15:58:11 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:11 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf 1G" returned: 0 in 0.536s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:11 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf Sep 28 15:58:11 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:12 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf" returned: 0 in 0.626s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:12 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:12 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf Sep 28 15:58:12 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Flow 'volume_create_manager' (2e59cab7-21c5-4a70-a797-4934d72a695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1487781-c17a-4b82-9607-eb06801af94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1487781-c17a-4b82-9607-eb06801af94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1076279714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780ca6f5-0c87-4bde-8fe8-885ff3427ff5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98f5bf3ff0d546ca97437159e921f09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:12Z,use_quota=True,user_id='1aca1597c9e8471185cfbb9d2c474cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548dfc1b-3d44-4582-b735-6b1ed2c2b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548dfc1b-3d44-4582-b735-6b1ed2c2b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30620337-46bf-4082-9da4-898d86821090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30620337-46bf-4082-9da4-898d86821090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780ca6f5-0c87-4bde-8fe8-885ff3427ff5', 'volume_name': 'volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d444239-4f01-427a-8a7a-6c9e89976792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d444239-4f01-427a-8a7a-6c9e89976792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c686b7-667f-43a1-a1ac-e5c262a090bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Volume 780ca6f5-0c87-4bde-8fe8-885ff3427ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5', 'volume_size': 1} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:12 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf" returned: 0 in 0.342s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:12 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info Sep 28 15:58:12 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:12 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info" returned: 0 in 0.282s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:12 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:13 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info Sep 28 15:58:13 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:13 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.info" returned: 0 in 0.312s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.807s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Creating offline snapshot ecd108bc-d11c-4d9f-827f-abd349d80d1f of volume dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca705bb5-6b12-4046-9d14-cf954edce723]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:13 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 Sep 28 15:58:13 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:13 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:13 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f 1G Sep 28 15:58:13 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:14 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f 1G" returned: 0 in 0.539s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfab6cad-d415-44cc-982c-02601c1c0286 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:14 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfab6cad-d415-44cc-982c-02601c1c0286 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f Sep 28 15:58:14 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:14 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfab6cad-d415-44cc-982c-02601c1c0286 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f" returned: 0 in 0.400s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:14 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:14 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f Sep 28 15:58:14 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:15 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f" returned: 0 in 0.261s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:15 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info Sep 28 15:58:15 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:15 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:15 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:15 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info Sep 28 15:58:15 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:15 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.info" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.296s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1076279714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780ca6f5-0c87-4bde-8fe8-885ff3427ff5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98f5bf3ff0d546ca97437159e921f09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:12Z,use_quota=True,user_id='1aca1597c9e8471185cfbb9d2c474cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Creating volume 780ca6f5-0c87-4bde-8fe8-885ff3427ff5 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:15 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:15 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 1073741824 Sep 28 15:58:15 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-185f84f9-2f29-4cc6-9b85-a7987da357e1 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 48149c08-55e2-47e5-9d51-5eb1749fe166: created successfully Sep 28 15:58:16 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 1073741824" returned: 0 in 0.657s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:16 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 Sep 28 15:58:16 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:16 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5" returned: 0 in 0.390s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c686b7-667f-43a1-a1ac-e5c262a090bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee88738-fa29-49e4-9bdf-215831d97af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Volume volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 (780ca6f5-0c87-4bde-8fe8-885ff3427ff5): created successfully Sep 28 15:58:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee88738-fa29-49e4-9bdf-215831d97af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Flow 'volume_create_manager' (2e59cab7-21c5-4a70-a797-4934d72a695f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-44ef1b7a-cfbc-45c8-92d9-e24a7ccd9c32 req-1fa0f9e0-c26d-453c-85a0-d00d4340cd64 tempest-VolumesGetTestJSON-336703337 None] Created volume successfully. Sep 28 15:58:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 48149c08-55e2-47e5-9d51-5eb1749fe166: deleting Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 48149c08-55e2-47e5-9d51-5eb1749fe166: deleting {{(pid=86628) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-ddccdd59-48e4-45a5-85f0-bbdfa897599c" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-ddccdd59-48e4-45a5-85f0-bbdfa897599c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-0520a7ab-d137-4722-9d22-b2a40daba0bf" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-0520a7ab-d137-4722-9d22-b2a40daba0bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Deleting offline snapshot 0520a7ab-d137-4722-9d22-b2a40daba0bf of volume ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] snapshot_file for this snap is: volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[16684944-b6e9-4237-b9ea-bb8a66daacf0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:17 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf Sep 28 15:58:17 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:17 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf" returned: 0 in 0.421s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c720a-4745-43a6-8123-e1f249ff7dc9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:17 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c Sep 28 15:58:17 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Flow 'volume_create_manager' (5f576170-65bc-4993-a1d5-ceafe36bc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b887c8-49e1-4d7a-b361-d57903cd88fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b887c8-49e1-4d7a-b361-d57903cd88fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1327260862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65e6aec-a417-465c-ad15-e65f6a9cd92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdba100a72864faebb9a7411ee139ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:18Z,use_quota=True,user_id='dead06ae60aa43fa80a53f701de4a01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c0aa27-a246-48fb-a9a7-8cb9a7c2605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c0aa27-a246-48fb-a9a7-8cb9a7c2605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573034b0-ff45-4e62-9d65-efa2bc848fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573034b0-ff45-4e62-9d65-efa2bc848fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65e6aec-a417-465c-ad15-e65f6a9cd92f', 'volume_name': 'volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c62908-49cf-4d05-9f6a-e118efb9f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c62908-49cf-4d05-9f6a-e118efb9f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff62f25-5304-411a-90cc-efa963b57565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:18 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Volume c65e6aec-a417-465c-ad15-e65f6a9cd92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f', 'volume_size': 1} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1327260862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65e6aec-a417-465c-ad15-e65f6a9cd92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdba100a72864faebb9a7411ee139ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:18Z,use_quota=True,user_id='dead06ae60aa43fa80a53f701de4a01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Creating volume c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:18 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:18 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f 1073741824 Sep 28 15:58:18 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Acquiring lock "cinder-780ca6f5-0c87-4bde-8fe8-885ff3427ff5-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Lock "cinder-780ca6f5-0c87-4bde-8fe8-885ff3427ff5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Acquiring lock "cinder-quobyte-780ca6f5-0c87-4bde-8fe8-885ff3427ff5" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:18 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c" returned: 0 in 0.524s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Lock "cinder-quobyte-780ca6f5-0c87-4bde-8fe8-885ff3427ff5" acquired by "delete_volume" :: waited 0.047s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:18 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf Sep 28 15:58:18 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e870261-57a3-409b-ac0e-88cf31823ad8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:18 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 Sep 28 15:58:18 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:18 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf" returned: 0 in 0.370s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:18 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f 1073741824" returned: 0 in 0.563s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:18 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf Sep 28 15:58:18 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:18 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f Sep 28 15:58:18 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:18 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5" returned: 0 in 0.521s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:18 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5 Sep 28 15:58:18 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:18 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c.0520a7ab-d137-4722-9d22-b2a40daba0bf" returned: 0 in 0.319s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:18 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-0520a7ab-d137-4722-9d22-b2a40daba0bf" released by "_delete_snapshot" :: held 1.849s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff62f25-5304-411a-90cc-efa963b57565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f903af-0afc-4a93-87cf-403cb22fb8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-ddccdd59-48e4-45a5-85f0-bbdfa897599c" released by "delete_snapshot" :: held 1.889s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:19 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Volume volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f (c65e6aec-a417-465c-ad15-e65f6a9cd92f): created successfully Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f903af-0afc-4a93-87cf-403cb22fb8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Flow 'volume_create_manager' (5f576170-65bc-4993-a1d5-ceafe36bc40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-dfab6cad-d415-44cc-982c-02601c1c0286" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-dfab6cad-d415-44cc-982c-02601c1c0286" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-ecd108bc-d11c-4d9f-827f-abd349d80d1f" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-caf8580e-1236-4eaa-97b9-40ceb266d556 req-dcedd010-847a-4463-a934-9bfd15ce3afd tempest-VolumesSnapshotsTestJSON-959710643 None] Created volume successfully. Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-ecd108bc-d11c-4d9f-827f-abd349d80d1f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Deleting offline snapshot ecd108bc-d11c-4d9f-827f-abd349d80d1f of volume dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] snapshot_file for this snap is: volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcbcd15-980c-47da-88ac-ba822d80ecf5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:19 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-780ca6f5-0c87-4bde-8fe8-885ff3427ff5" returned: 0 in 0.347s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Lock "cinder-quobyte-780ca6f5-0c87-4bde-8fe8-885ff3427ff5" released by "delete_volume" :: held 0.923s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:19 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f Sep 28 15:58:19 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.quota [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Created reservations ['f735fb24-fef3-4424-8e4d-028ec777a3a3', 'b11d1793-8ee1-4d90-aa52-6716ab1ed58c', 'a924f189-416a-47de-8a08-45ee40e2ef75', 'a96916d3-a091-416c-b0cd-0b75b6b06a46'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:19 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:19 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:19 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f" returned: 0 in 0.473s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfab6cad-d415-44cc-982c-02601c1c0286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16aa9e0-9ade-42c6-8263-5713589adf67]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:19 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.manager [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Deleted volume successfully. Sep 28 15:58:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-4fe0c650-81c2-433d-a1ce-0e841e23a12a req-1476867e-59df-4130-98c8-0db77842937e tempest-VolumesGetTestJSON-336703337 None] Lock "cinder-780ca6f5-0c87-4bde-8fe8-885ff3427ff5-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:19 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 Sep 28 15:58:19 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:20 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286" returned: 0 in 0.487s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:20 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f Sep 28 15:58:20 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Creating offline snapshot 68be5062-325d-4145-851d-f872d2ab09b3 of volume c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250bc8a-4efd-4b75-9bfd-b3606f9e0d6c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:20 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f" returned: 0 in 0.540s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:20 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f Sep 28 15:58:20 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:20 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f Sep 28 15:58:20 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:21 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286.ecd108bc-d11c-4d9f-827f-abd349d80d1f" returned: 0 in 0.432s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:21 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f" returned: 0 in 0.597s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-ecd108bc-d11c-4d9f-827f-abd349d80d1f" released by "_delete_snapshot" :: held 2.073s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-dfab6cad-d415-44cc-982c-02601c1c0286" released by "delete_snapshot" :: held 2.104s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:21 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 1G Sep 28 15:58:21 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:21 devstack cinder-volume[86628]: WARNING cinder.quota [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-595970770 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-595970770, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:21 devstack cinder-volume[86628]: WARNING cinder.quota [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-595970770 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-595970770, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['d94433a3-46cf-40a0-97f8-c031c0e4b260', 'a63b2e65-c70b-43ed-a80f-91b9056ee1e2', 'e6463e8d-4677-480d-8c1d-745370f9eb1d', '9521b807-44ce-4666-bf33-f2c6a05025e0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['a6e94c85-66f4-4854-8a15-22d97a4b14b9', '43f3991e-efec-4037-9206-827bd8b266e5', '680a97c9-30ed-4586-908b-79a151cb82fa', 'dda5edff-4a31-4743-b8f7-d8d5421022b2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:21 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e0d980f1-22fd-427f-b396-4cadf3019ca0 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 48149c08-55e2-47e5-9d51-5eb1749fe166: deleted successfully Sep 28 15:58:21 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 1G" returned: 0 in 0.553s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:21 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 Sep 28 15:58:21 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:22 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3" returned: 0 in 0.367s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:22 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 is being set with open permissions: ugo+rw Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:22 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 Sep 28 15:58:22 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-ddccdd59-48e4-45a5-85f0-bbdfa897599c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-ddccdd59-48e4-45a5-85f0-bbdfa897599c" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a6e298-6ae5-4517-b289-28f5f6689c00]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:22 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3" returned: 0 in 0.304s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:22 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c Sep 28 15:58:22 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:22 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info Sep 28 15:58:22 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:22 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c" returned: 0 in 0.417s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:22 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c Sep 28 15:58:22 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:22 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info" returned: 0 in 0.348s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:22 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info is being set with open permissions: ugo+rw Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:22 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info Sep 28 15:58:22 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:22 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ddccdd59-48e4-45a5-85f0-bbdfa897599c" returned: 0 in 0.295s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-ddccdd59-48e4-45a5-85f0-bbdfa897599c" released by "delete_volume" :: held 0.810s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-dfab6cad-d415-44cc-982c-02601c1c0286" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-dfab6cad-d415-44cc-982c-02601c1c0286" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:23 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.info" returned: 0 in 0.289s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38e118d-85a4-49ed-ab08-9e647b6d0c26]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-0ce2f701-a7b0-47a3-a44f-705d017f72f7 req-ac82f4c1-be58-423b-af19-ff2bb14d406e tempest-VolumesSnapshotsTestJSON-959710643 None] Create snapshot completed successfully Sep 28 15:58:23 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 Sep 28 15:58:23 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:23 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286" returned: 0 in 0.449s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:23 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286 Sep 28 15:58:23 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:23 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dfab6cad-d415-44cc-982c-02601c1c0286" returned: 0 in 0.238s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-dfab6cad-d415-44cc-982c-02601c1c0286" released by "delete_volume" :: held 0.788s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['cb51aebf-8450-49b2-9311-445c4e810369'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:23 devstack cinder-volume[86628]: WARNING cinder.quota [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-595970770 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-595970770, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:23 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['b5b58453-5fb2-4549-96f9-cc2274ff9a93', '5df5981f-6b53-4586-b9b3-6b9bf4d1dc51', '45e6ad2a-0890-4dee-ae53-774289922508', '6689b96d-9f1a-4841-b1a8-855de206f7e3'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['5a64d8c0-3850-460e-b1f9-6a7f9bb87c39', '1a3414e5-02d9-45d0-8f15-8f24001f6ce8', '79407404-d110-4174-8026-eb81640f8ee1', 'e44f837b-ae10-432f-bb41-91939e9b3837'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:24 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:24 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "cinder-68be5062-325d-4145-851d-f872d2ab09b3-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Flow 'volume_create_manager' (5a9264ed-d06c-4684-91a6-e94babb4c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7248b3-b4cf-441b-91b0-79ad6d4ab25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-68be5062-325d-4145-851d-f872d2ab09b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "cinder-quobyte-c65e6aec-a417-465c-ad15-e65f6a9cd92f" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7248b3-b4cf-441b-91b0-79ad6d4ab25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1056296562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87e7eae-593e-4368-9fe3-f23ac17d27e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3a08b54e8a41749366a097be5acefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:24Z,use_quota=True,user_id='bc21b7a7907f4c50ab34beaebe5ebcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee94fcb8-b330-4c33-a49e-08da8ed184f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee94fcb8-b330-4c33-a49e-08da8ed184f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c7094-b2f7-42d1-8428-2b3fb36e7304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c7094-b2f7-42d1-8428-2b3fb36e7304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87e7eae-593e-4368-9fe3-f23ac17d27e6', 'volume_name': 'volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d30a70-7432-4118-b63c-ceacf89e86be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d30a70-7432-4118-b63c-ceacf89e86be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e83f37d-78fd-4175-9612-7a349f050f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:24 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Volume b87e7eae-593e-4368-9fe3-f23ac17d27e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6', 'volume_size': 1} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1056296562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87e7eae-593e-4368-9fe3-f23ac17d27e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3a08b54e8a41749366a097be5acefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:24Z,use_quota=True,user_id='bc21b7a7907f4c50ab34beaebe5ebcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Creating volume b87e7eae-593e-4368-9fe3-f23ac17d27e6 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:24 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-quobyte-c65e6aec-a417-465c-ad15-e65f6a9cd92f" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "cinder-quobyte-68be5062-325d-4145-851d-f872d2ab09b3" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:24 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 1073741824 Sep 28 15:58:24 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-quobyte-68be5062-325d-4145-851d-f872d2ab09b3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Deleting offline snapshot 68be5062-325d-4145-851d-f872d2ab09b3 of volume c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] snapshot_file for this snap is: volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fccb84-fbf1-4e24-9c7f-c18b50bd31d3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:24 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.313s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6fce0a83-f09c-4eb1-b375-d4d9f2efde92 tempest-GroupSnapshotsTest-2081199139 None] Delete group completed successfully. Sep 28 15:58:24 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 Sep 28 15:58:24 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:24 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3" returned: 0 in 0.441s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95248a1-346b-4095-9aab-f3ad6966aa62]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:25 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 1073741824" returned: 0 in 0.577s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:25 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 Sep 28 15:58:25 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:25 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f Sep 28 15:58:25 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-37083fc1-1849-4af4-9636-24edda290d37 tempest-GroupSnapshotsTest-2081199139 None] Group tempest-GroupSnapshotsTest-Group-1064818796: creating Sep 28 15:58:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-37083fc1-1849-4af4-9636-24edda290d37 tempest-GroupSnapshotsTest-2081199139 None] Group tempest-GroupSnapshotsTest-Group-1064818796: created successfully Sep 28 15:58:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-37083fc1-1849-4af4-9636-24edda290d37 tempest-GroupSnapshotsTest-2081199139 None] Create group completed successfully. Sep 28 15:58:25 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6" returned: 0 in 0.391s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e83f37d-78fd-4175-9612-7a349f050f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09705d1a-a316-4d40-98c1-72c28bc12170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:25 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Volume volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 (b87e7eae-593e-4368-9fe3-f23ac17d27e6): created successfully Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09705d1a-a316-4d40-98c1-72c28bc12170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Flow 'volume_create_manager' (5a9264ed-d06c-4684-91a6-e94babb4c584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1494b510-d0cb-4a89-acc8-0639ba1fc6d1 tempest-VolumesTestJSON-298585750 None] Created volume successfully. Sep 28 15:58:25 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f" returned: 0 in 0.527s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:25 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 Sep 28 15:58:25 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:25 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3" returned: 0 in 0.320s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:25 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3 Sep 28 15:58:25 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:26 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f.68be5062-325d-4145-851d-f872d2ab09b3" returned: 0 in 0.249s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-quobyte-68be5062-325d-4145-851d-f872d2ab09b3" released by "_delete_snapshot" :: held 1.680s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-quobyte-c65e6aec-a417-465c-ad15-e65f6a9cd92f" released by "delete_snapshot" :: held 1.704s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:26 devstack cinder-volume[86628]: WARNING cinder.quota [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG cinder.quota [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Created reservations ['7b4d584e-ccd5-496e-9c12-b8904b3e08f3', '47d09a08-67ff-43df-aa0e-00fec905c10c', '28922334-9242-4cd8-83be-f78d08c3503b', 'e7612c6b-355c-44d0-adc1-c57e995bd07f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Delete snapshot completed successfully. Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-3a470794-8d89-4618-88d1-deea8235e35a req-4768a8d9-0955-41a6-ac55-7fe42ff25cf0 tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-68be5062-325d-4145-851d-f872d2ab09b3-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:26 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:26 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (7cb80ca7-ea04-420a-868e-89370799dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfda02f-9974-4239-a9d2-37322d191dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "cinder-c65e6aec-a417-465c-ad15-e65f6a9cd92f-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:27 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfda02f-9974-4239-a9d2-37322d191dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384662478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d9016b9-5d26-45fe-b999-fd705c993a4b,host='devstack@QuobyteHD#QuobyteHD',id=1894c1bb-7496-4d66-8f53-bc105c92f374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:27Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf31857-0bbc-4de0-8aeb-acd8aab4a204),volume_type_id=bcf31857-0bbc-4de0-8aeb-acd8aab4a204)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b1b11b-feef-4d49-bfd5-1d101a146976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b1b11b-feef-4d49-bfd5-1d101a146976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2673ea14-49c1-422d-9765-bd52d2952827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2673ea14-49c1-422d-9765-bd52d2952827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1894c1bb-7496-4d66-8f53-bc105c92f374', 'volume_name': 'volume-1894c1bb-7496-4d66-8f53-bc105c92f374', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd9cb84-467f-42ca-b332-5e4ade5f52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd9cb84-467f-42ca-b332-5e4ade5f52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99b29d1-a2bd-43e7-9091-cea48b3b9271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Volume 1894c1bb-7496-4d66-8f53-bc105c92f374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1894c1bb-7496-4d66-8f53-bc105c92f374', 'volume_size': 1} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d9016b9-5d26-45fe-b999-fd705c993a4b,created_at=2026-09-28T13:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384662478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d9016b9-5d26-45fe-b999-fd705c993a4b,host='devstack@QuobyteHD#QuobyteHD',id=1894c1bb-7496-4d66-8f53-bc105c92f374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f930ca58743e44cc946344da8da66d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:27Z,use_quota=True,user_id='88c1100b91d04b709a7669eec3de0225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf31857-0bbc-4de0-8aeb-acd8aab4a204),volume_type_id=bcf31857-0bbc-4de0-8aeb-acd8aab4a204)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Creating volume 1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:27 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.521s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-c65e6aec-a417-465c-ad15-e65f6a9cd92f-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 8 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:58:27 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 1073741824 Sep 28 15:58:27 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "cinder-quobyte-c65e6aec-a417-465c-ad15-e65f6a9cd92f" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Flow 'volume_create_manager' (b9c70bda-6094-41fc-aed9-d0e948e2caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349f62dc-7f9f-47fa-a04d-fedcf66bd690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-quobyte-c65e6aec-a417-465c-ad15-e65f6a9cd92f" acquired by "delete_volume" :: waited 0.047s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349f62dc-7f9f-47fa-a04d-fedcf66bd690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-920621765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c99dd0f-5e15-43ee-aad4-831203e25849,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3a08b54e8a41749366a097be5acefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:27Z,use_quota=True,user_id='bc21b7a7907f4c50ab34beaebe5ebcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd19b58-9745-43f6-a1b6-30cd93202d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd19b58-9745-43f6-a1b6-30cd93202d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371c09bb-9bea-42f6-921d-039beb060a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371c09bb-9bea-42f6-921d-039beb060a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c99dd0f-5e15-43ee-aad4-831203e25849', 'volume_name': 'volume-7c99dd0f-5e15-43ee-aad4-831203e25849', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177a1c1c-d360-4f4b-b50b-3dc9f7ace22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177a1c1c-d360-4f4b-b50b-3dc9f7ace22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ad0b48-31cf-42a0-b6fe-3383011c49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:27 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Volume 7c99dd0f-5e15-43ee-aad4-831203e25849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c99dd0f-5e15-43ee-aad4-831203e25849', 'volume_size': 1} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bfc43d-f493-4c6b-a4ec-20e98dc26e19]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:27 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f Sep 28 15:58:27 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:27 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 1073741824" returned: 0 in 0.629s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:27 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f" returned: 0 in 0.456s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:27 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 Sep 28 15:58:27 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:27 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f Sep 28 15:58:27 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:28 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374" returned: 0 in 0.251s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-920621765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c99dd0f-5e15-43ee-aad4-831203e25849,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3a08b54e8a41749366a097be5acefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:27Z,use_quota=True,user_id='bc21b7a7907f4c50ab34beaebe5ebcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Creating volume 7c99dd0f-5e15-43ee-aad4-831203e25849 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:28 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:28 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99b29d1-a2bd-43e7-9091-cea48b3b9271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1894c1bb-7496-4d66-8f53-bc105c92f374', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:28 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 1073741824 Sep 28 15:58:28 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a0800e-8dbe-4897-8441-23f28781647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c65e6aec-a417-465c-ad15-e65f6a9cd92f" returned: 0 in 0.294s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Volume volume-1894c1bb-7496-4d66-8f53-bc105c92f374 (1894c1bb-7496-4d66-8f53-bc105c92f374): created successfully Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a0800e-8dbe-4897-8441-23f28781647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Flow 'volume_create_manager' (7cb80ca7-ea04-420a-868e-89370799dc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-quobyte-c65e6aec-a417-465c-ad15-e65f6a9cd92f" released by "delete_volume" :: held 0.912s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-79cadf39-d0bc-4302-b91b-d6b00d852e03 tempest-GroupSnapshotsTest-2081199139 None] Created volume successfully. Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.quota [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Created reservations ['437fb5b6-448f-4bf9-b46b-6ac44d8cfd18', 'e41ea200-d36d-4911-a0b7-297cfafef2a7', '9b163e79-e896-4a05-8a0c-3d84b7fc1fbd', 'a4a81d50-816d-4f08-9d10-64ef299ec855'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:28 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:28 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Flow 'volume_create_manager' (fe056cab-221b-472d-b080-f7163b930a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a4ee6b-a43c-4e36-896a-f3037e23fd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a4ee6b-a43c-4e36-896a-f3037e23fd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-518245590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c845cd6-40d7-4d2e-a544-371a03785d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01109cc610a43ad952a6ce6298dc7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:29Z,use_quota=True,user_id='71723b30312943929be6abac308f0840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13130aab-d0cc-4c3b-a966-98926082b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13130aab-d0cc-4c3b-a966-98926082b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1a4cc9-902f-474f-a0c4-b80a01412dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1a4cc9-902f-474f-a0c4-b80a01412dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c845cd6-40d7-4d2e-a544-371a03785d2e', 'volume_name': 'volume-3c845cd6-40d7-4d2e-a544-371a03785d2e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415b5f51-20d1-4db9-a956-5f0b6ac19992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415b5f51-20d1-4db9-a956-5f0b6ac19992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745319ce-7d2c-4f26-8e63-8d108593d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Volume 3c845cd6-40d7-4d2e-a544-371a03785d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c845cd6-40d7-4d2e-a544-371a03785d2e', 'volume_size': 1} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:28 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 1073741824" returned: 0 in 0.644s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:28 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.337s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.manager [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Deleted volume successfully. Sep 28 15:58:28 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 Sep 28 15:58:28 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-72dcea5c-ac32-4f65-838a-22d74bb5f347 req-a9960fed-94bd-4da1-b58b-6a6341b1e18d tempest-VolumesSnapshotsTestJSON-959710643 None] Lock "cinder-c65e6aec-a417-465c-ad15-e65f6a9cd92f-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:29 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-518245590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c845cd6-40d7-4d2e-a544-371a03785d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01109cc610a43ad952a6ce6298dc7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:29Z,use_quota=True,user_id='71723b30312943929be6abac308f0840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Creating volume 3c845cd6-40d7-4d2e-a544-371a03785d2e {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:29 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ad0b48-31cf-42a0-b6fe-3383011c49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c99dd0f-5e15-43ee-aad4-831203e25849', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:29 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e 1073741824 Sep 28 15:58:29 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03f168c-5ec1-4361-adb9-84e961d9bf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Volume volume-7c99dd0f-5e15-43ee-aad4-831203e25849 (7c99dd0f-5e15-43ee-aad4-831203e25849): created successfully Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03f168c-5ec1-4361-adb9-84e961d9bf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Flow 'volume_create_manager' (b9c70bda-6094-41fc-aed9-d0e948e2caf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5f3840c8-0d04-478f-9bdc-92c5c94b191d tempest-VolumesTestJSON-298585750 None] Created volume successfully. Sep 28 15:58:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] GroupSnapshot 0bfa87dd-7210-47d1-ae0e-2f16567abb96: creating. Sep 28 15:58:30 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e 1073741824" returned: 0 in 0.790s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Group snapshot 0bfa87dd-7210-47d1-ae0e-2f16567abb96: creating. {{(pid=86628) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:30 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e Sep 28 15:58:30 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:30 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e" returned: 0 in 0.308s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.349s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745319ce-7d2c-4f26-8e63-8d108593d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c845cd6-40d7-4d2e-a544-371a03785d2e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90929011-c02b-479d-bf58-ec9537dbd0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Creating offline snapshot d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 of volume 1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:58:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Volume volume-3c845cd6-40d7-4d2e-a544-371a03785d2e (3c845cd6-40d7-4d2e-a544-371a03785d2e): created successfully Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90929011-c02b-479d-bf58-ec9537dbd0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Flow 'volume_create_manager' (fe056cab-221b-472d-b080-f7163b930a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e5189-4859-408b-b229-bb234a52a9ed]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4a2c2819-7133-42bf-83b0-a3950399d70e tempest-ServerActionsTestOtherA-1827865301 None] Created volume successfully. Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Flow 'volume_create_manager' (c36035a4-f36f-4e62-9564-48a0476ef992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cedb34c-fdb7-4538-a38b-c6b97013d8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cedb34c-fdb7-4538-a38b-c6b97013d8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-902062325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78d9c4f-ac88-4fc9-aff4-f8399d22d35a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3a08b54e8a41749366a097be5acefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:31Z,use_quota=True,user_id='bc21b7a7907f4c50ab34beaebe5ebcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:30 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 Sep 28 15:58:30 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e1bdc9-6cf8-4304-969a-5b631c3f565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e1bdc9-6cf8-4304-969a-5b631c3f565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53614e78-cda6-4627-b21e-ec9c425adec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53614e78-cda6-4627-b21e-ec9c425adec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78d9c4f-ac88-4fc9-aff4-f8399d22d35a', 'volume_name': 'volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e56cc05-af54-4f88-8060-d2bec1ded66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e56cc05-af54-4f88-8060-d2bec1ded66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccff8fa7-b6e1-4c29-963b-57b4653154e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Volume a78d9c4f-ac88-4fc9-aff4-f8399d22d35a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a', 'volume_size': 1} Sep 28 15:58:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:31 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374" returned: 0 in 0.485s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:31 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 1G Sep 28 15:58:31 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:31 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 1G" returned: 0 in 0.549s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1894c1bb-7496-4d66-8f53-bc105c92f374 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:31 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1894c1bb-7496-4d66-8f53-bc105c92f374 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 Sep 28 15:58:31 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:31 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1894c1bb-7496-4d66-8f53-bc105c92f374 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" returned: 0 in 0.364s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:31 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:31 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 Sep 28 15:58:31 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:32 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:32 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info Sep 28 15:58:32 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:32 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info" returned: 0 in 0.347s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:32 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:32 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info Sep 28 15:58:32 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:32 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.info" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.318s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-902062325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78d9c4f-ac88-4fc9-aff4-f8399d22d35a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a3a08b54e8a41749366a097be5acefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:31Z,use_quota=True,user_id='bc21b7a7907f4c50ab34beaebe5ebcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Creating volume a78d9c4f-ac88-4fc9-aff4-f8399d22d35a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:33 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:33 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a 1073741824 Sep 28 15:58:33 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0b83b951-c441-42bc-9afa-c0981261b238 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 0bfa87dd-7210-47d1-ae0e-2f16567abb96: created successfully Sep 28 15:58:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 0bfa87dd-7210-47d1-ae0e-2f16567abb96: deleting Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 0bfa87dd-7210-47d1-ae0e-2f16567abb96: deleting {{(pid=86628) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:58:33 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a 1073741824" returned: 0 in 0.605s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-1894c1bb-7496-4d66-8f53-bc105c92f374" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-1894c1bb-7496-4d66-8f53-bc105c92f374" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Deleting offline snapshot d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 of volume 1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] snapshot_file for this snap is: volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[26caf74c-9a5b-4eb9-853f-1d87f875e4e9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:33 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a Sep 28 15:58:33 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:33 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 Sep 28 15:58:33 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:34 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a" returned: 0 in 0.322s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccff8fa7-b6e1-4c29-963b-57b4653154e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6c5ce4-5935-42eb-b722-a254bd2a211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:34 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Volume volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a (a78d9c4f-ac88-4fc9-aff4-f8399d22d35a): created successfully Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6c5ce4-5935-42eb-b722-a254bd2a211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Flow 'volume_create_manager' (c36035a4-f36f-4e62-9564-48a0476ef992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3382515d-045e-4e6f-88df-d56921ebc6fe tempest-VolumesTestJSON-298585750 None] Created volume successfully. Sep 28 15:58:34 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" returned: 0 in 0.531s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1894c1bb-7496-4d66-8f53-bc105c92f374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b64b33b-8f6e-4d7c-abc3-f0daf5c7adaf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:34 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 Sep 28 15:58:34 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:34 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374" returned: 0 in 0.543s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:34 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 Sep 28 15:58:34 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8179dffb-b984-43b6-b509-aaf0b6800308 tempest-GroupSnapshotsV319Test-505913621 None] Group tempest-GroupSnapshotsV319Test-Group-277809589: creating Sep 28 15:58:35 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" returned: 0 in 0.612s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8179dffb-b984-43b6-b509-aaf0b6800308 tempest-GroupSnapshotsV319Test-505913621 None] Group tempest-GroupSnapshotsV319Test-Group-277809589: created successfully Sep 28 15:58:35 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25 Sep 28 15:58:35 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8179dffb-b984-43b6-b509-aaf0b6800308 tempest-GroupSnapshotsV319Test-505913621 None] Create group completed successfully. Sep 28 15:58:35 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374.d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" returned: 0 in 0.316s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-d6bf8bb7-9509-4d70-bc81-3c0ff3297f25" released by "_delete_snapshot" :: held 2.217s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-1894c1bb-7496-4d66-8f53-bc105c92f374" released by "delete_snapshot" :: held 2.260s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=134,cinder:UPDATE=155,cinder:INSERT=35,cinder:DELETE=7 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:35 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=139,cinder:UPDATE=153,cinder:INSERT=36,cinder:DELETE=10 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:36 devstack cinder-volume[86628]: WARNING cinder.quota [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-742399173 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-742399173, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:36 devstack cinder-volume[86628]: WARNING cinder.quota [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-742399173 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-742399173, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['5d454728-966e-4bca-b484-8c559e024338', '51485a3b-b00d-4448-81f9-d140112fca13', '6952f7b0-1212-4069-a88d-5a83cd25d900', '10e0a633-6196-4c30-85f7-ea3e0d18f7c4'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-47e7f386-c25c-41cc-87cb-d5b804296b32 tempest-GroupSnapshotsTest-2081199139 None] group_snapshot 0bfa87dd-7210-47d1-ae0e-2f16567abb96: deleted successfully Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Acquiring lock "cinder-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Lock "cinder-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Acquiring lock "cinder-quobyte-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Lock "cinder-quobyte-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bcfdd9-4523-4d1e-95a3-8aeef998bd79]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:36 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a Sep 28 15:58:36 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:37 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a" returned: 0 in 0.490s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:37 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a Sep 28 15:58:37 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:37 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Lock "cinder-quobyte-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a" released by "delete_volume" :: held 1.089s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Flow 'volume_create_manager' (cf6beea7-e3cf-4fc2-9731-b36391405cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcb694c-43bc-4ccb-a699-700f55a9c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcb694c-43bc-4ccb-a699-700f55a9c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727126221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0fba6ec-c201-475b-8d01-850887b77f46,host='devstack@QuobyteHD#QuobyteHD',id=284c2be8-f1eb-4bbe-9f01-4b68460f635b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32cdc4edd66244248a314b696cd92e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:37Z,use_quota=True,user_id='d33ad09350c64cbe8399bee403cbd5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b19eb6e-304f-4c25-b3db-bd5a71c95ddb),volume_type_id=0b19eb6e-304f-4c25-b3db-bd5a71c95ddb)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f709e4d3-8508-4c05-b2af-918ffc48e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f709e4d3-8508-4c05-b2af-918ffc48e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c114646b-fb5f-4d44-915c-8ef58014ddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c114646b-fb5f-4d44-915c-8ef58014ddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284c2be8-f1eb-4bbe-9f01-4b68460f635b', 'volume_name': 'volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b506a5d4-13de-4294-a047-6fa8c83cf2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b506a5d4-13de-4294-a047-6fa8c83cf2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdf91db-c501-4aa6-84a5-7e94a498c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:37 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Volume 284c2be8-f1eb-4bbe-9f01-4b68460f635b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b', 'volume_size': 1} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0fba6ec-c201-475b-8d01-850887b77f46,created_at=2026-09-28T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727126221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0fba6ec-c201-475b-8d01-850887b77f46,host='devstack@QuobyteHD#QuobyteHD',id=284c2be8-f1eb-4bbe-9f01-4b68460f635b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32cdc4edd66244248a314b696cd92e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:37Z,use_quota=True,user_id='d33ad09350c64cbe8399bee403cbd5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b19eb6e-304f-4c25-b3db-bd5a71c95ddb),volume_type_id=0b19eb6e-304f-4c25-b3db-bd5a71c95ddb)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Creating volume 284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:37 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:37 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b 1073741824 Sep 28 15:58:37 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "cinder-quobyte-1894c1bb-7496-4d66-8f53-bc105c92f374" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Created reservations ['3dd267ce-a0c9-4f98-9c99-0fece2e9133f', '8f72bbfd-56f6-437d-b5b1-7bdc61a04ca5', '79066b5a-309e-4e34-b9a9-2572cd527e8f', 'c66f76cc-1694-4dde-a79f-e5de0d980d3e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-1894c1bb-7496-4d66-8f53-bc105c92f374" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205d1fb-5780-47cf-92cd-718e578aebb1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:38 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:38 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:38 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 Sep 28 15:58:38 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:38 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b 1073741824" returned: 0 in 0.700s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:38 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.452s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Deleted volume successfully. Sep 28 15:58:38 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:38 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b Sep 28 15:58:38 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374" returned: 0 in 0.687s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:38 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374 Sep 28 15:58:38 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ce8a26c0-6371-4abf-9ecd-6c1bae80a6a3 tempest-VolumesTestJSON-298585750 None] Lock "cinder-a78d9c4f-ac88-4fc9-aff4-f8399d22d35a-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Acquiring lock "cinder-7c99dd0f-5e15-43ee-aad4-831203e25849-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Lock "cinder-7c99dd0f-5e15-43ee-aad4-831203e25849-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Acquiring lock "cinder-quobyte-7c99dd0f-5e15-43ee-aad4-831203e25849" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Lock "cinder-quobyte-7c99dd0f-5e15-43ee-aad4-831203e25849" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:39 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:39 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1894c1bb-7496-4d66-8f53-bc105c92f374" returned: 0 in 0.585s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf05fe-daae-4ad2-b369-0f1d04b0d0a7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b" returned: 0 in 0.716s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Lock "cinder-quobyte-1894c1bb-7496-4d66-8f53-bc105c92f374" released by "delete_volume" :: held 1.414s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdf91db-c501-4aa6-84a5-7e94a498c50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3e677-e781-4385-98ad-e46561c6b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:39 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Volume volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b (284c2be8-f1eb-4bbe-9f01-4b68460f635b): created successfully Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3e677-e781-4385-98ad-e46561c6b618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Flow 'volume_create_manager' (cf6beea7-e3cf-4fc2-9731-b36391405cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6955dab8-df45-4e06-9add-d8ae289be31a tempest-GroupSnapshotsV319Test-505913621 None] Created volume successfully. Sep 28 15:58:39 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 Sep 28 15:58:39 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['18a06d5b-7e86-4567-a06e-9bf1d5a62fa7'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:39 devstack cinder-volume[86628]: WARNING cinder.quota [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-742399173 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-742399173, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Created reservations ['4bb37d14-1ddd-4bc0-88ad-399ecf1510c0', '58ea427d-8725-4554-9e04-275752ace7bb', 'cd7536ae-c9e5-485b-b385-3c3046ca636c', '62246244-8400-4e93-b8ea-b621df55b448'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:39 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:39 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:39 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849" returned: 0 in 0.612s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:39 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849 Sep 28 15:58:39 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:40 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.339s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f9b76f73-51f9-465d-b8cc-e49a1417b6d9 tempest-GroupSnapshotsTest-2081199139 None] Delete group completed successfully. Sep 28 15:58:40 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c99dd0f-5e15-43ee-aad4-831203e25849" returned: 0 in 0.383s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Lock "cinder-quobyte-7c99dd0f-5e15-43ee-aad4-831203e25849" released by "delete_volume" :: held 1.114s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Created reservations ['ee2143fc-ee55-4648-b87c-f12434b58212', '8ea55d72-aaf4-4a47-b31c-ef2a29dbf567', '1ecf5a41-cc33-431a-b041-50e4c6082b95', '157499bd-aaeb-4fef-a9f8-6667d47ae818'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:40 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:40 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] GroupSnapshot 0174d3ae-4940-4a53-a167-f4e2c5ee54b2: creating. Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Group snapshot 0174d3ae-4940-4a53-a167-f4e2c5ee54b2: creating. {{(pid=86628) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Creating offline snapshot 310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 of volume 284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fd3691-fa48-4b98-9ad4-96f940b92e99]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:40 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b Sep 28 15:58:40 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:41 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:41 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Deleted volume successfully. Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af8f08a6-eb80-4dec-9c0a-29cb3076841c tempest-VolumesTestJSON-298585750 None] Lock "cinder-7c99dd0f-5e15-43ee-aad4-831203e25849-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:41 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b" returned: 0 in 0.540s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:41 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 1G Sep 28 15:58:41 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Acquiring lock "cinder-b87e7eae-593e-4368-9fe3-f23ac17d27e6-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Lock "cinder-b87e7eae-593e-4368-9fe3-f23ac17d27e6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Acquiring lock "cinder-quobyte-b87e7eae-593e-4368-9fe3-f23ac17d27e6" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Lock "cinder-quobyte-b87e7eae-593e-4368-9fe3-f23ac17d27e6" acquired by "delete_volume" :: waited 0.069s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3e623-41ff-466a-bf06-32f892344f04]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:42 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 Sep 28 15:58:42 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:42 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 1G" returned: 0 in 0.971s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:42 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 Sep 28 15:58:42 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:42 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6" returned: 0 in 0.796s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:42 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6 Sep 28 15:58:42 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:42 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" returned: 0 in 0.622s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:42 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:43 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 Sep 28 15:58:43 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:43 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" returned: 0 in 0.475s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:43 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b87e7eae-593e-4368-9fe3-f23ac17d27e6" returned: 0 in 0.667s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Lock "cinder-quobyte-b87e7eae-593e-4368-9fe3-f23ac17d27e6" released by "delete_volume" :: held 1.588s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:43 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info Sep 28 15:58:43 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Created reservations ['ecf71855-28bc-48e0-bf9a-c7d31d944070', '21e5151d-957b-488a-8659-4c7aed97ed5d', '7cfe15d3-f30d-401c-a97b-df86c56e2d1d', 'ad6c6fd5-105c-44a0-aa13-e409e364c22b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:43 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:43 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:44 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info" returned: 0 in 0.519s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:44 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:44 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info Sep 28 15:58:44 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:44 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.424s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Deleted volume successfully. Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52c167e6-b133-48b9-986a-a1c6c4298d59 tempest-VolumesTestJSON-298585750 None] Lock "cinder-b87e7eae-593e-4368-9fe3-f23ac17d27e6-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:44 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.info" returned: 0 in 0.479s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.793s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-47099387-e98a-49ca-85d5-9b5c1a281b1f tempest-GroupSnapshotsV319Test-505913621 None] group_snapshot 0174d3ae-4940-4a53-a167-f4e2c5ee54b2: created successfully Sep 28 15:58:45 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] group_snapshot 0174d3ae-4940-4a53-a167-f4e2c5ee54b2: deleting Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] group_snapshot 0174d3ae-4940-4a53-a167-f4e2c5ee54b2: deleting {{(pid=86628) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "cinder-quobyte-284c2be8-f1eb-4bbe-9f01-4b68460f635b" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Lock "cinder-quobyte-284c2be8-f1eb-4bbe-9f01-4b68460f635b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "cinder-quobyte-310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Lock "cinder-quobyte-310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Deleting offline snapshot 310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 of volume 284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] snapshot_file for this snap is: volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f292b19-261d-446c-8fc6-863d665c1c27]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:46 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 Sep 28 15:58:46 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:46 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" returned: 0 in 0.613s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d80fafe-e9cb-4211-957e-1897eb6944af]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:47 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b Sep 28 15:58:47 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:47 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b" returned: 0 in 0.720s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:47 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 Sep 28 15:58:47 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:48 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" returned: 0 in 0.472s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:48 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0 Sep 28 15:58:48 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:48 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b.310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" returned: 0 in 0.469s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Lock "cinder-quobyte-310be6e8-a2ba-4e90-8cfe-0f1eee54d6e0" released by "_delete_snapshot" :: held 2.493s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Lock "cinder-quobyte-284c2be8-f1eb-4bbe-9f01-4b68460f635b" released by "delete_snapshot" :: held 2.533s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:48 devstack cinder-volume[86628]: WARNING cinder.quota [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-441120810 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-441120810, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:48 devstack cinder-volume[86628]: WARNING cinder.quota [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-441120810 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-441120810, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:48 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] Created reservations ['3d7fde97-1aa8-4d50-a324-e4514f47505c', '238bf1de-11b7-4029-84a3-642b5f452dde', 'c5aca73f-e9a0-4b80-9249-fe38005ebf09', 'e6e8311f-8fa2-4a07-906a-632a9fd626fc'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:48 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-51a893f3-2542-44a8-96c4-2dc7c8d641f3 tempest-GroupSnapshotsV319Test-505913621 None] group_snapshot 0174d3ae-4940-4a53-a167-f4e2c5ee54b2: deleted successfully Sep 28 15:58:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "cinder-quobyte-284c2be8-f1eb-4bbe-9f01-4b68460f635b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Lock "cinder-quobyte-284c2be8-f1eb-4bbe-9f01-4b68460f635b" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff844886-dcec-481c-bbfa-66de4b278776]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:50 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b Sep 28 15:58:50 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:50 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b" returned: 0 in 0.545s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:50 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b Sep 28 15:58:50 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:51 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-284c2be8-f1eb-4bbe-9f01-4b68460f635b" returned: 0 in 0.378s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Lock "cinder-quobyte-284c2be8-f1eb-4bbe-9f01-4b68460f635b" released by "delete_volume" :: held 1.068s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Created reservations ['360a65c2-ff71-4f5b-9d42-92183f4da1ba'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:51 devstack cinder-volume[86628]: WARNING cinder.quota [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-441120810 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-441120810, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Created reservations ['553d22ed-7f78-4ee1-b4c0-613aa801cb41', 'fd2f7eec-9eab-44bc-b23b-dc45c4848b06', '2f4c577a-8da1-4342-9557-4798ed7ea847', '60e952ed-3f15-4cb9-ab9d-348d79c7e1fe'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:58:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-038ef0a9-5b22-44b2-bcbe-9dc68b76c41a tempest-GroupsV314Test-1781269463 None] Group tempest-GroupsV314Test-Group-942050206: creating Sep 28 15:58:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-038ef0a9-5b22-44b2-bcbe-9dc68b76c41a tempest-GroupsV314Test-1781269463 None] Group tempest-GroupsV314Test-Group-942050206: created successfully Sep 28 15:58:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-038ef0a9-5b22-44b2-bcbe-9dc68b76c41a tempest-GroupsV314Test-1781269463 None] Create group completed successfully. Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:51 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:58:51 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:52 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.309s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:52 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:52 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d68dd441-0cec-4ddb-8d33-14d6791fe996 tempest-GroupSnapshotsV319Test-505913621 None] Delete group completed successfully. Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Flow 'volume_create_manager' (ffea12b8-2e7e-4dda-8ffc-e35732b786fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc646b3-09a1-4df5-ac24-dd0eb2a21679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc646b3-09a1-4df5-ac24-dd0eb2a21679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1473167849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=431201e4-c55d-4ec5-a629-5838c030b46d,host='devstack@QuobyteHD#QuobyteHD',id=0d611fea-19e7-4db7-9a7b-2f13c53ec3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b2ec72dc36447ab8c2063214a292b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:54Z,use_quota=True,user_id='62e7f06f73214de3b88eeaece53d3cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(933e732a-1e9a-47fa-a9e1-df1f03090cff),volume_type_id=933e732a-1e9a-47fa-a9e1-df1f03090cff)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a53d58a-5976-4c80-9518-2d59a2e65644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a53d58a-5976-4c80-9518-2d59a2e65644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8fb4d6-e6f6-4c60-a658-ffa2ef3abf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8fb4d6-e6f6-4c60-a658-ffa2ef3abf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d611fea-19e7-4db7-9a7b-2f13c53ec3af', 'volume_name': 'volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9337d073-9667-4635-abae-1923d1e32969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9337d073-9667-4635-abae-1923d1e32969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e751a397-75a7-4f52-b8d1-f172c96e9fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:53 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Volume 0d611fea-19e7-4db7-9a7b-2f13c53ec3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af', 'volume_size': 1} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=431201e4-c55d-4ec5-a629-5838c030b46d,created_at=2026-09-28T13:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1473167849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=431201e4-c55d-4ec5-a629-5838c030b46d,host='devstack@QuobyteHD#QuobyteHD',id=0d611fea-19e7-4db7-9a7b-2f13c53ec3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b2ec72dc36447ab8c2063214a292b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:58:54Z,use_quota=True,user_id='62e7f06f73214de3b88eeaece53d3cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(933e732a-1e9a-47fa-a9e1-df1f03090cff),volume_type_id=933e732a-1e9a-47fa-a9e1-df1f03090cff)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:58:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Creating volume 0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:58:54 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:54 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af 1073741824 Sep 28 15:58:54 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:54 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af 1073741824" returned: 0 in 0.690s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:54 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af Sep 28 15:58:54 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:55 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" returned: 0 in 0.465s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e751a397-75a7-4f52-b8d1-f172c96e9fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75cf3692-82fe-431b-9992-bac5b42c3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:58:55 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Volume volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af (0d611fea-19e7-4db7-9a7b-2f13c53ec3af): created successfully Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75cf3692-82fe-431b-9992-bac5b42c3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:58:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Flow 'volume_create_manager' (ffea12b8-2e7e-4dda-8ffc-e35732b786fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:58:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-900220a3-1896-4be8-82de-2291f1b132b3 tempest-GroupsV314Test-1781269463 None] Created volume successfully. Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:57 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Cloning volume 0d611fea-19e7-4db7-9a7b-2f13c53ec3af to volume dea213a4-fc77-406e-9a23-7b56870050f6 Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Creating offline snapshot fafad967-be37-454c-9982-ec4d1a7a0632 of volume 0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2c7089-849e-4a05-af51-ce50d8e270cc]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:57 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af Sep 28 15:58:57 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:57 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" returned: 0 in 0.467s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:57 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 1G Sep 28 15:58:57 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b890142e-2dd9-45f1-9fbe-2f1a6f74aee3 tempest-GroupsTest-1951472762 None] Group tempest-Group1-1407901043: creating Sep 28 15:58:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b890142e-2dd9-45f1-9fbe-2f1a6f74aee3 tempest-GroupsTest-1951472762 None] Group tempest-Group1-1407901043: created successfully Sep 28 15:58:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b890142e-2dd9-45f1-9fbe-2f1a6f74aee3 tempest-GroupsTest-1951472762 None] Create group completed successfully. Sep 28 15:58:58 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 1G" returned: 0 in 0.536s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:58 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 Sep 28 15:58:58 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:58 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632" returned: 0 in 0.333s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:58 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:58 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 Sep 28 15:58:58 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:58 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632" returned: 0 in 0.281s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:59 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info Sep 28 15:58:59 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:59 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info" returned: 0 in 0.275s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:59 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:59 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info Sep 28 15:58:59 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2602502e-6f77-4c76-b6a5-9eeea55b2761 tempest-GroupsTest-1951472762 None] Group tempest-Group2-1032038754: creating Sep 28 15:58:59 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.info" returned: 0 in 0.282s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Acquiring lock "cinder-quobyte-dea213a4-fc77-406e-9a23-7b56870050f6" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-dea213a4-fc77-406e-9a23-7b56870050f6" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] snapshot: fafad967-be37-454c-9982-ec4d1a7a0632, volume: dea213a4-fc77-406e-9a23-7b56870050f6, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:58:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2602502e-6f77-4c76-b6a5-9eeea55b2761 tempest-GroupsTest-1951472762 None] Group tempest-Group2-1032038754: created successfully Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f15ed0b-9678-451e-b4b9-66811793bc44]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:58:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2602502e-6f77-4c76-b6a5-9eeea55b2761 tempest-GroupsTest-1951472762 None] Create group completed successfully. Sep 28 15:58:59 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 Sep 28 15:58:59 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:00 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632" returned: 0 in 0.448s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9667dd9-80f0-4600-8779-df3efa63d970]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:00 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af Sep 28 15:59:00 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:00 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" returned: 0 in 0.409s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:59:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:00 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 Sep 28 15:59:00 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Flow 'volume_create_manager' (c442b0fa-a8d3-432e-8b3d-3699d9db289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b059434b-f3e3-438f-8c80-51a89e2464f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b059434b-f3e3-438f-8c80-51a89e2464f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-30943359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e2ab3f1-f1e9-42a9-a25f-5f8c31bd91ef,host='devstack@QuobyteHD#QuobyteHD',id=aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a77367a374aabb7c0459f7eefe374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:01Z,use_quota=True,user_id='c5e1f06486524cfc958a8e839e03f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d72fd75-14d5-49b9-ad10-c356fc8f75eb),volume_type_id=8d72fd75-14d5-49b9-ad10-c356fc8f75eb)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31a8d52-7609-4f49-b852-f53008e07adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31a8d52-7609-4f49-b852-f53008e07adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6635e0f-f959-41a2-938f-3c362ed050c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6635e0f-f959-41a2-938f-3c362ed050c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc', 'volume_name': 'volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed95894-12bf-4e49-91d2-be69e8c862fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed95894-12bf-4e49-91d2-be69e8c862fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52a1a62-8a32-4b0b-a66a-da9bf24ffb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Volume aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc', 'volume_size': 1} Sep 28 15:59:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:10 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6" returned: 0 in 9.514s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af, size 1024.00 MB, duration 9.52 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:59:10 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Converted 1024.00 MB image at 107.62 MB/s Sep 28 15:59:10 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:10 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 Sep 28 15:59:10 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:10 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6" returned: 0 in 0.365s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-dea213a4-fc77-406e-9a23-7b56870050f6" released by "_copy_volume_from_snapshot" :: held 10.830s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Acquiring lock "cinder-quobyte-fafad967-be37-454c-9982-ec4d1a7a0632" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-fafad967-be37-454c-9982-ec4d1a7a0632" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Deleting offline snapshot fafad967-be37-454c-9982-ec4d1a7a0632 of volume 0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] snapshot_file for this snap is: volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed9809e-3aec-4bcf-8734-d116d5162caf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-d9440bf5-309d-409c-a4a3-fc550ecd52f1 req-f69e8417-b1b3-4de7-917c-a49937becdf3 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:10 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 Sep 28 15:59:10 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:11 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632" returned: 0 in 0.479s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b7f8d-c333-4599-82b3-9cfb75587da0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:11 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af Sep 28 15:59:11 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:11 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" returned: 0 in 0.570s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:11 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 Sep 28 15:59:11 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:12 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632" returned: 0 in 0.398s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:12 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632 Sep 28 15:59:12 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:12 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af.fafad967-be37-454c-9982-ec4d1a7a0632" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-fafad967-be37-454c-9982-ec4d1a7a0632" released by "_delete_snapshot" :: held 1.906s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.152s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.777s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e2ab3f1-f1e9-42a9-a25f-5f8c31bd91ef,created_at=2026-09-28T13:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-30943359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e2ab3f1-f1e9-42a9-a25f-5f8c31bd91ef,host='devstack@QuobyteHD#QuobyteHD',id=aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a77367a374aabb7c0459f7eefe374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:01Z,use_quota=True,user_id='c5e1f06486524cfc958a8e839e03f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d72fd75-14d5-49b9-ad10-c356fc8f75eb),volume_type_id=8d72fd75-14d5-49b9-ad10-c356fc8f75eb)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Creating volume aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:12 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:12 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc 1073741824 Sep 28 15:59:12 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0f600fff-d8fb-416f-a540-e113c27e3176 tempest-GroupsV314Test-1781269463 None] Create group from source-group-431201e4-c55d-4ec5-a629-5838c030b46d completed successfully. Sep 28 15:59:13 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc 1073741824" returned: 0 in 0.618s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:13 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc Sep 28 15:59:13 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:13 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc" returned: 0 in 0.338s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-d9440bf5-309d-409c-a4a3-fc550ecd52f1 req-f69e8417-b1b3-4de7-917c-a49937becdf3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.879s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52a1a62-8a32-4b0b-a66a-da9bf24ffb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51158499-e78f-4416-8c5f-03c97fbba37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-d9440bf5-309d-409c-a4a3-fc550ecd52f1 req-f69e8417-b1b3-4de7-917c-a49937becdf3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Volume volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc (aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc): created successfully Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51158499-e78f-4416-8c5f-03c97fbba37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Flow 'volume_create_manager' (c442b0fa-a8d3-432e-8b3d-3699d9db289c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ea1ab5b9-f253-4bca-b843-a225141fec3b tempest-GroupsTest-1951472762 None] Created volume successfully. Sep 28 15:59:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-d9440bf5-309d-409c-a4a3-fc550ecd52f1 req-f69e8417-b1b3-4de7-917c-a49937becdf3 tempest-ServerActionsTestOtherA-1827865301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-3c845cd6-40d7-4d2e-a544-371a03785d2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74d10db0-fbf8-4f97-a5e8-3e42124759b5', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:59:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-d9440bf5-309d-409c-a4a3-fc550ecd52f1 req-f69e8417-b1b3-4de7-917c-a49937becdf3 tempest-ServerActionsTestOtherA-1827865301 None] attachment_update completed successfully. Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Acquiring lock "cinder-quobyte-dea213a4-fc77-406e-9a23-7b56870050f6" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-dea213a4-fc77-406e-9a23-7b56870050f6" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3665f8ba-c577-4301-a539-8fb8cc32e506]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:14 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 Sep 28 15:59:14 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Acquiring lock "cinder-quobyte-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Lock "cinder-quobyte-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627b825-9474-4c3b-899f-255c65ba709d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:15 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc Sep 28 15:59:15 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:15 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6" returned: 0 in 0.678s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:15 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6 Sep 28 15:59:15 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:15 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc" returned: 0 in 0.585s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:15 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc Sep 28 15:59:15 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:15 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dea213a4-fc77-406e-9a23-7b56870050f6" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-dea213a4-fc77-406e-9a23-7b56870050f6" released by "delete_volume" :: held 1.127s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Created reservations ['7adf1be8-0cba-4c0c-a28f-768a49d40e27'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:15 devstack cinder-volume[86628]: WARNING cinder.quota [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-422833864 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-422833864, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:15 devstack cinder-volume[86628]: WARNING cinder.quota [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-422833864 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-422833864, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Created reservations ['d17bf163-44de-4199-8251-af2234c980fb', '5e39ac89-ef1d-4cea-963f-3153f6761ebe', 'b1336a2f-afb3-4ca2-8c2a-f172d8873a05', 'b2fa9642-a77a-424b-b775-7d6a713e04ed'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:15 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc" returned: 0 in 0.333s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Lock "cinder-quobyte-aa7a78f6-9429-4c60-a7d7-b8ad235ad2cc" released by "delete_volume" :: held 1.006s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:15 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:15 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Created reservations ['806835d5-25af-432f-a4f8-4d71d472bb2f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:16 devstack cinder-volume[86628]: WARNING cinder.quota [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1085780286 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1085780286, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:16 devstack cinder-volume[86628]: WARNING cinder.quota [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1085780286 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1085780286, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Created reservations ['8f4cb94f-1b9a-4d41-92d0-7a0e59050bf3', '3cde70d3-a4f5-4ac2-a40e-859cad50ece3', 'e4b9418c-090a-4fa4-9449-73bf555ea9a0', '9c0553a0-5899-4f7f-9823-48d9b01fc211'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:16 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:16 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:16 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.525s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-93c5bb51-cde7-4828-a9bc-77869feb5c78 tempest-GroupsV314Test-1781269463 None] Delete group completed successfully. Sep 28 15:59:16 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.350s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cc81439f-79dc-48e3-a39e-87483703a5c6 tempest-GroupsTest-1951472762 None] Delete group completed successfully. Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Acquiring lock "cinder-quobyte-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" acquired by "delete_volume" :: waited 0.050s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390c92c-3870-447b-ad0c-26295cc95399]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Created reservations ['6c8f2bcb-549e-4656-a501-a14466cb1bbc'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:17 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af Sep 28 15:59:17 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:17 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:17 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:18 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" returned: 0 in 0.710s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:18 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.374s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9a40a852-945f-426d-93f7-1fedb87172f4 tempest-GroupsTest-1951472762 None] Delete group completed successfully. Sep 28 15:59:18 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af Sep 28 15:59:18 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:18 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" returned: 0 in 0.336s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Lock "cinder-quobyte-0d611fea-19e7-4db7-9a7b-2f13c53ec3af" released by "delete_volume" :: held 1.269s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Created reservations ['c52dd7be-c4fa-4a42-a8fb-9d5303d0a121'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Created reservations ['1e96cc2e-7ee6-45e4-9c2e-b97c418bc2a4', '02f4ac9c-fc54-45d1-9047-86ae93964734', '8b2264a9-4438-48ad-a6b8-d625bf9c3b7f', '03bf84ad-2f23-4abb-b4fc-21efdf5ba8cb'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-506a233d-3006-4cd4-9c5e-f86fba38ef4b tempest-ServerActionsTestOtherA-1827865301 None] Terminate volume connection completed successfully. Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-506a233d-3006-4cd4-9c5e-f86fba38ef4b tempest-ServerActionsTestOtherA-1827865301 None] Deleting attachment 74d10db0-fbf8-4f97-a5e8-3e42124759b5. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:19 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:19 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:19 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.562s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:19 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-89c54457-b338-4a8f-a690-a3969adef019 tempest-GroupsV314Test-1781269463 None] Delete group completed successfully. Sep 28 15:59:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9c89b4cd-7374-4557-a925-22dc108f0433 tempest-GroupsTest-1951472762 None] Group tempest-GroupsTest-Group-520148774: creating Sep 28 15:59:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9c89b4cd-7374-4557-a925-22dc108f0433 tempest-GroupsTest-1951472762 None] Group tempest-GroupsTest-Group-520148774: created successfully Sep 28 15:59:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9c89b4cd-7374-4557-a925-22dc108f0433 tempest-GroupsTest-1951472762 None] Create group completed successfully. Sep 28 15:59:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-211c5eef-8908-46db-9ce0-4e589b49d33f tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-211c5eef-8908-46db-9ce0-4e589b49d33f tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-211c5eef-8908-46db-9ce0-4e589b49d33f tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-211c5eef-8908-46db-9ce0-4e589b49d33f tempest-ServerActionsTestOtherA-1827865301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-3c845cd6-40d7-4d2e-a544-371a03785d2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd015f3f2-616b-4118-a6b8-158749858163', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:59:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-7aee1a4a-f381-4cc1-be23-f93acc210137 req-211c5eef-8908-46db-9ce0-4e589b49d33f tempest-ServerActionsTestOtherA-1827865301 None] attachment_update completed successfully. Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Flow 'volume_create_manager' (88bd1fd0-535e-4116-8e15-87ccd1df0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1590528-e3ef-4990-b469-cd0dd342dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1590528-e3ef-4990-b469-cd0dd342dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2108228532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4d8d15c-5683-4552-b0a8-4b88f6a92ed1,host='devstack@QuobyteHD#QuobyteHD',id=a14b5ac5-cfe8-4a90-a4df-ad8da6dca652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a77367a374aabb7c0459f7eefe374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:22Z,use_quota=True,user_id='c5e1f06486524cfc958a8e839e03f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85818b98-ab0c-465f-822c-bd8e4a968614),volume_type_id=85818b98-ab0c-465f-822c-bd8e4a968614)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8191f3f-f267-460b-8a64-1cd03553dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8191f3f-f267-460b-8a64-1cd03553dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70611f94-cbe3-4c5e-9b91-2c9fd3574cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70611f94-cbe3-4c5e-9b91-2c9fd3574cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14b5ac5-cfe8-4a90-a4df-ad8da6dca652', 'volume_name': 'volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d478312-71d5-4d89-99e2-3a612f89dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d478312-71d5-4d89-99e2-3a612f89dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed17821-65c7-42d8-8975-3b9627c00310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:22 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Volume a14b5ac5-cfe8-4a90-a4df-ad8da6dca652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652', 'volume_size': 1} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4d8d15c-5683-4552-b0a8-4b88f6a92ed1,created_at=2026-09-28T13:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2108228532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4d8d15c-5683-4552-b0a8-4b88f6a92ed1,host='devstack@QuobyteHD#QuobyteHD',id=a14b5ac5-cfe8-4a90-a4df-ad8da6dca652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a77367a374aabb7c0459f7eefe374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:22Z,use_quota=True,user_id='c5e1f06486524cfc958a8e839e03f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85818b98-ab0c-465f-822c-bd8e4a968614),volume_type_id=85818b98-ab0c-465f-822c-bd8e4a968614)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Creating volume a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:22 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:22 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 1073741824 Sep 28 15:59:22 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:23 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 1073741824" returned: 0 in 0.733s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:23 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 Sep 28 15:59:23 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:24 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652" returned: 0 in 0.571s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed17821-65c7-42d8-8975-3b9627c00310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cfd24d-1df1-44ab-a754-bd983e9e2e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:24 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Volume volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 (a14b5ac5-cfe8-4a90-a4df-ad8da6dca652): created successfully Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cfd24d-1df1-44ab-a754-bd983e9e2e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Flow 'volume_create_manager' (88bd1fd0-535e-4116-8e15-87ccd1df0766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-798233a6-fe73-4b25-a81d-3b7f6700ce40 tempest-GroupsTest-1951472762 None] Created volume successfully. Sep 28 15:59:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7e8b4327-caf9-4b2a-b354-1df5461e3922 tempest-GroupsV320Test-1267274036 None] Group tempest-GroupsV320Test-Group-1657181585: creating Sep 28 15:59:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7e8b4327-caf9-4b2a-b354-1df5461e3922 tempest-GroupsV320Test-1267274036 None] Group tempest-GroupsV320Test-Group-1657181585: created successfully Sep 28 15:59:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7e8b4327-caf9-4b2a-b354-1df5461e3922 tempest-GroupsV320Test-1267274036 None] Create group completed successfully. Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Flow 'volume_create_manager' (06e86f7f-bc1d-41db-92bc-3e574dba7273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1443f4e-a174-4014-8db5-421328291306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1443f4e-a174-4014-8db5-421328291306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624451598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4d8d15c-5683-4552-b0a8-4b88f6a92ed1,host='devstack@QuobyteHD#QuobyteHD',id=126f7dc1-e6ca-4f92-b643-60cab0eb212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a77367a374aabb7c0459f7eefe374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:26Z,use_quota=True,user_id='c5e1f06486524cfc958a8e839e03f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85818b98-ab0c-465f-822c-bd8e4a968614),volume_type_id=85818b98-ab0c-465f-822c-bd8e4a968614)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55679067-66f6-4683-a8d3-b93cadd0596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55679067-66f6-4683-a8d3-b93cadd0596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0bb1b9-885d-4780-9248-1c9611b65b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0bb1b9-885d-4780-9248-1c9611b65b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126f7dc1-e6ca-4f92-b643-60cab0eb212b', 'volume_name': 'volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2be9d7-e73d-4903-afe9-3f3412c72a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2be9d7-e73d-4903-afe9-3f3412c72a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79a7fc5-d6c0-4221-bc22-05a4845123cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:26 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Volume 126f7dc1-e6ca-4f92-b643-60cab0eb212b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b', 'volume_size': 1} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4d8d15c-5683-4552-b0a8-4b88f6a92ed1,created_at=2026-09-28T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624451598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4d8d15c-5683-4552-b0a8-4b88f6a92ed1,host='devstack@QuobyteHD#QuobyteHD',id=126f7dc1-e6ca-4f92-b643-60cab0eb212b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a77367a374aabb7c0459f7eefe374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:26Z,use_quota=True,user_id='c5e1f06486524cfc958a8e839e03f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85818b98-ab0c-465f-822c-bd8e4a968614),volume_type_id=85818b98-ab0c-465f-822c-bd8e4a968614)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Creating volume 126f7dc1-e6ca-4f92-b643-60cab0eb212b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:26 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:26 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b 1073741824 Sep 28 15:59:26 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Created reservations ['4b3ddb3d-b5a5-4db8-8924-1b879bfadaba'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:26 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:26 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:26 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:26 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:27 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.447s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:27 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-75fd5232-29df-4b97-aedb-14807fd72a05 tempest-GroupsV320Test-1267274036 None] Delete group completed successfully. Sep 28 15:59:27 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.608s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 8 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:59:27 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b 1073741824" returned: 0 in 1.377s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:28 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b Sep 28 15:59:28 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:28 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79a7fc5-d6c0-4221-bc22-05a4845123cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd34c444-36ac-4bb3-b69e-437b04e9858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Volume volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b (126f7dc1-e6ca-4f92-b643-60cab0eb212b): created successfully Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd34c444-36ac-4bb3-b69e-437b04e9858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Flow 'volume_create_manager' (06e86f7f-bc1d-41db-92bc-3e574dba7273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f67ca1fd-27d2-47bb-9bde-d061b6efc2d9 tempest-GroupsTest-1951472762 None] Created volume successfully. Sep 28 15:59:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bb8240a4-7af6-4dbd-8715-d58ee457a9ec tempest-GroupsTest-1951472762 None] Update group completed successfully. Sep 28 15:59:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9a2f249b-7015-4e60-95de-064c88629fef tempest-GroupsTest-1951472762 None] Update group completed successfully. Sep 28 15:59:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Acquiring lock "cinder-quobyte-126f7dc1-e6ca-4f92-b643-60cab0eb212b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Lock "cinder-quobyte-126f7dc1-e6ca-4f92-b643-60cab0eb212b" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:32 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c80239-983d-4023-b2e9-8ad4dedfd5e2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:33 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b Sep 28 15:59:33 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:33 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b" returned: 0 in 0.588s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:33 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b Sep 28 15:59:33 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:33 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-126f7dc1-e6ca-4f92-b643-60cab0eb212b" returned: 0 in 0.399s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Lock "cinder-quobyte-126f7dc1-e6ca-4f92-b643-60cab0eb212b" released by "delete_volume" :: held 1.058s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Acquiring lock "cinder-quobyte-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Lock "cinder-quobyte-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:34 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[800af70b-36e9-4e5c-b621-ecdebbdccc55]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:34 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 Sep 28 15:59:34 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:34 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652" returned: 0 in 0.611s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:34 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652 Sep 28 15:59:34 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:35 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652" returned: 0 in 0.429s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Lock "cinder-quobyte-a14b5ac5-cfe8-4a90-a4df-ad8da6dca652" released by "delete_volume" :: held 1.115s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Created reservations ['1971bda1-faca-4c70-9f98-f8a1db381353'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:35 devstack cinder-volume[86628]: WARNING cinder.quota [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-918038700 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-918038700, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:35 devstack cinder-volume[86628]: WARNING cinder.quota [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-918038700 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-918038700, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Created reservations ['155d3a86-46dd-44e5-81ac-f1a96c05d186', 'af8a950d-0f84-4ab3-b7cc-ba3784ff9ffa', 'b56bbef1-c608-4f7d-aac9-231b611bacce', '825dc9ba-7eb9-470f-ac04-d0eb3b5fd082'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Created reservations ['87cb5071-8c56-45d3-afa0-71ef33ca861d', '7c92bea3-8c58-4ce2-a8f2-a59985b061b2', 'd7bb85df-c8a5-401a-bcc3-06fef3083fa3', '8e62afdb-63c3-4335-9ac0-91b7cc94393a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:35 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:35 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:36 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.390s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:36 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-02fed9ec-f4d5-4068-9fd9-73c91f70f541 tempest-GroupsTest-1951472762 None] Delete group completed successfully. Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=144,cinder:INSERT=35,cinder:UPDATE=132,cinder:DELETE=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=136,cinder:INSERT=29,cinder:UPDATE=156,cinder:DELETE=5 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Flow 'volume_create_manager' (a8b4ca35-8478-4b42-bc79-a8a4b37c7425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa3fe15-c7e9-4693-a7f1-3faed43e60e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa3fe15-c7e9-4693-a7f1-3faed43e60e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1528516979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f60db25-a2fc-4791-bb10-b609d686c726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdcaaa4c7c7e405291c399fdc9547f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:39Z,use_quota=True,user_id='cd939fe69feb4f89b321dc99eeaf251d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396404a6-c61c-4601-b659-73e663557814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396404a6-c61c-4601-b659-73e663557814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3015437-99b9-4f3a-8d72-0ee64a444bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3015437-99b9-4f3a-8d72-0ee64a444bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f60db25-a2fc-4791-bb10-b609d686c726', 'volume_name': 'volume-9f60db25-a2fc-4791-bb10-b609d686c726', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80632ec5-85b4-4d2f-9eca-d8f76291fb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80632ec5-85b4-4d2f-9eca-d8f76291fb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b856e95d-5582-4127-93af-afe0c14c9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:39 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Volume 9f60db25-a2fc-4791-bb10-b609d686c726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f60db25-a2fc-4791-bb10-b609d686c726', 'volume_size': 1} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1528516979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f60db25-a2fc-4791-bb10-b609d686c726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdcaaa4c7c7e405291c399fdc9547f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:39Z,use_quota=True,user_id='cd939fe69feb4f89b321dc99eeaf251d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Creating volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:39 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:39 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 1073741824 Sep 28 15:59:39 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:40 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 1073741824" returned: 0 in 0.790s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:40 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 Sep 28 15:59:40 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:40 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726" returned: 0 in 0.345s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b856e95d-5582-4127-93af-afe0c14c9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f60db25-a2fc-4791-bb10-b609d686c726', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9143f2b-1012-41be-bbdb-5f4f6190e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:40 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Volume volume-9f60db25-a2fc-4791-bb10-b609d686c726 (9f60db25-a2fc-4791-bb10-b609d686c726): created successfully Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9143f2b-1012-41be-bbdb-5f4f6190e010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Flow 'volume_create_manager' (a8b4ca35-8478-4b42-bc79-a8a4b37c7425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d825a4d2-f588-408a-91c7-07ca90c6d357 tempest-SnapshotsActionsTest-1457458162 None] Created volume successfully. Sep 28 15:59:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Creating offline snapshot 106a278f-0884-4770-9040-1dd1965261a9 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:59:41 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e702dcb-8491-4a6d-bee4-953f7025dd71]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:41 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 Sep 28 15:59:41 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:42 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726" returned: 0 in 0.419s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:42 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 1G Sep 28 15:59:42 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Flow 'volume_create_manager' (c3d6788f-78cb-48b2-9993-90678fbc5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7442c5c1-d0f6-4ef0-9e26-0ef1fcb63116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7442c5c1-d0f6-4ef0-9e26-0ef1fcb63116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1497574767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeac9b73-5ab7-442c-a409-054fc5fa7646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c5d8f4e72644108c78af6f488fb359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:42Z,use_quota=True,user_id='4b27609e124f4d7ebb3be8b3bbd225bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e211951-e386-484d-ab2a-4d1102b0f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e211951-e386-484d-ab2a-4d1102b0f654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbadea4-e0bb-4dae-99ed-58331f015078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbadea4-e0bb-4dae-99ed-58331f015078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeac9b73-5ab7-442c-a409-054fc5fa7646', 'volume_name': 'volume-aeac9b73-5ab7-442c-a409-054fc5fa7646', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520536bb-c03a-47ce-a8e1-991f6f3cd36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520536bb-c03a-47ce-a8e1-991f6f3cd36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4437e67a-331e-48dd-9a2d-22848f3304a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Volume aeac9b73-5ab7-442c-a409-054fc5fa7646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeac9b73-5ab7-442c-a409-054fc5fa7646', 'volume_size': 1} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:42 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 1G" returned: 0 in 0.531s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:42 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 15:59:42 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:43 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:43 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 is being set with open permissions: ugo+rw Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:43 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 15:59:43 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:43 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.251s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:43 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info Sep 28 15:59:43 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:43 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info" returned: 0 in 0.336s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:43 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info is being set with open permissions: ugo+rw Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:43 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info Sep 28 15:59:43 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:43 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.info" returned: 0 in 0.334s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1497574767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeac9b73-5ab7-442c-a409-054fc5fa7646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c5d8f4e72644108c78af6f488fb359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:42Z,use_quota=True,user_id='4b27609e124f4d7ebb3be8b3bbd225bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Creating volume aeac9b73-5ab7-442c-a409-054fc5fa7646 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:44 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:44 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 1073741824 Sep 28 15:59:44 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-396766a1-3d76-4abf-9be9-b784d8ad93ba tempest-SnapshotsActionsTest-1457458162 None] Create snapshot completed successfully Sep 28 15:59:44 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 1073741824" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:44 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 Sep 28 15:59:44 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:44 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646" returned: 0 in 0.322s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4437e67a-331e-48dd-9a2d-22848f3304a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeac9b73-5ab7-442c-a409-054fc5fa7646', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f90fc-761f-4816-9715-8b2ed6f08270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:45 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Volume volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 (aeac9b73-5ab7-442c-a409-054fc5fa7646): created successfully Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f90fc-761f-4816-9715-8b2ed6f08270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Flow 'volume_create_manager' (c3d6788f-78cb-48b2-9993-90678fbc5d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:45 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ffe4a9a7-4130-4e6f-a437-62b338ebc03e tempest-VolumesServicesTestJSON-1097355868 None] Created volume successfully. Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Creating offline snapshot 0422e0ca-39e2-41f8-94d8-832320ab1112 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa9271-c4ba-48af-8ad7-06e42bc52b6d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:45 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 15:59:45 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Flow 'volume_create_manager' (433ae73a-2ac4-4133-9507-2652565c3a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62436c02-3293-460e-942b-5017d05b4653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62436c02-3293-460e-942b-5017d05b4653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1595706004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6822f8f9-55fd-4c46-8a94-5d3609337254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20322db2a8bc4191809182a9e2408d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:46Z,use_quota=True,user_id='54380aac055145a8b7296470b6baea58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28ba3e0-e43c-4075-bf4b-b5f52c741125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28ba3e0-e43c-4075-bf4b-b5f52c741125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b64a76-b7ca-4142-8a51-a875f14a6551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b64a76-b7ca-4142-8a51-a875f14a6551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6822f8f9-55fd-4c46-8a94-5d3609337254', 'volume_name': 'volume-6822f8f9-55fd-4c46-8a94-5d3609337254', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ffcf17-7d86-46b8-a084-27d706b14cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ffcf17-7d86-46b8-a084-27d706b14cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48c17e9-2de7-4c81-92e6-1b9af6e16264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:45 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Volume 6822f8f9-55fd-4c46-8a94-5d3609337254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6822f8f9-55fd-4c46-8a94-5d3609337254', 'volume_size': 1} Sep 28 15:59:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Acquiring lock "cinder-aeac9b73-5ab7-442c-a409-054fc5fa7646-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Lock "cinder-aeac9b73-5ab7-442c-a409-054fc5fa7646-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Acquiring lock "cinder-quobyte-aeac9b73-5ab7-442c-a409-054fc5fa7646" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:46 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Lock "cinder-quobyte-aeac9b73-5ab7-442c-a409-054fc5fa7646" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.511s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5f6116-6990-4f7e-902c-9dfd8083bc14]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:46 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 1G Sep 28 15:59:46 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:46 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 Sep 28 15:59:46 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:46 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646" returned: 0 in 0.511s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:46 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646 Sep 28 15:59:46 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:46 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 1G" returned: 0 in 0.666s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:46 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 Sep 28 15:59:46 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:47 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-aeac9b73-5ab7-442c-a409-054fc5fa7646" returned: 0 in 0.333s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Lock "cinder-quobyte-aeac9b73-5ab7-442c-a409-054fc5fa7646" released by "delete_volume" :: held 0.906s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Created reservations ['a523006f-9ea6-4beb-b74b-3dca15d4bad5', '9096d5e2-e70f-4982-8a86-8ddde949889d', 'befc680d-be0e-4aff-ae71-66a778ba27d5', 'a094d0fc-e57d-4b7c-b531-14002064e759'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:47 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112" returned: 0 in 0.433s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:47 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 is being set with open permissions: ugo+rw Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:47 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 Sep 28 15:59:47 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:47 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:47 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:47 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.300s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:47 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Deleted volume successfully. Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6a71f5e8-91d0-4fb2-b485-012a45947be4 tempest-VolumesServicesTestJSON-1097355868 None] Lock "cinder-aeac9b73-5ab7-442c-a409-054fc5fa7646-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:47 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.900s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1595706004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6822f8f9-55fd-4c46-8a94-5d3609337254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20322db2a8bc4191809182a9e2408d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:46Z,use_quota=True,user_id='54380aac055145a8b7296470b6baea58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Creating volume 6822f8f9-55fd-4c46-8a94-5d3609337254 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:47 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:47 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 1073741824 Sep 28 15:59:47 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:47 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8a324dd2-a6b5-4887-a590-6e6ae63dd6ad tempest-SnapshotsActionsTest-1457458162 None] Create snapshot completed successfully Sep 28 15:59:48 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 1073741824" returned: 0 in 0.688s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:48 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 Sep 28 15:59:48 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:48 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48c17e9-2de7-4c81-92e6-1b9af6e16264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6822f8f9-55fd-4c46-8a94-5d3609337254', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23639ef9-e7cb-4b0a-bc37-7484ed0acd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Volume volume-6822f8f9-55fd-4c46-8a94-5d3609337254 (6822f8f9-55fd-4c46-8a94-5d3609337254): created successfully Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23639ef9-e7cb-4b0a-bc37-7484ed0acd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Flow 'volume_create_manager' (433ae73a-2ac4-4133-9507-2652565c3a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-0422e0ca-39e2-41f8-94d8-832320ab1112-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9aa8a141-08a8-4c3a-b889-838dd5e9a5a4 tempest-VolumeQuotasAdminTestJSON-960842059 None] Created volume successfully. Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-0422e0ca-39e2-41f8-94d8-832320ab1112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-0422e0ca-39e2-41f8-94d8-832320ab1112" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-0422e0ca-39e2-41f8-94d8-832320ab1112" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Deleting offline snapshot 0422e0ca-39e2-41f8-94d8-832320ab1112 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] snapshot_file for this snap is: volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b88947-ad30-4f9f-aaa4-710a53b6dcfe]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:49 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 Sep 28 15:59:49 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:49 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112" returned: 0 in 0.459s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[deab11e7-3df6-4b05-bf37-8282f6615742]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:49 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 15:59:49 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "cinder-6822f8f9-55fd-4c46-8a94-5d3609337254-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "cinder-6822f8f9-55fd-4c46-8a94-5d3609337254-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:50 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.643s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:50 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 Sep 28 15:59:50 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "cinder-quobyte-6822f8f9-55fd-4c46-8a94-5d3609337254" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "cinder-quobyte-6822f8f9-55fd-4c46-8a94-5d3609337254" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7df0dda-c220-4573-8c13-70b90360e5ac]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:50 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 Sep 28 15:59:50 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:51 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112" returned: 0 in 0.783s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:51 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:51 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112 Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254" returned: 0 in 0.616s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:51 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:51 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254 Sep 28 15:59:51 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:51 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.0422e0ca-39e2-41f8-94d8-832320ab1112" returned: 0 in 0.338s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-0422e0ca-39e2-41f8-94d8-832320ab1112" released by "_delete_snapshot" :: held 2.397s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" released by "delete_snapshot" :: held 2.436s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:51 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6822f8f9-55fd-4c46-8a94-5d3609337254" returned: 0 in 0.438s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "cinder-quobyte-6822f8f9-55fd-4c46-8a94-5d3609337254" released by "delete_volume" :: held 1.156s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Created reservations ['8fdf0a49-ccfe-49b2-a8ee-8a43a3866ed1', 'feea88f7-d248-49e0-b14f-0e3fdff7609f', '8ed2780b-c6de-4cca-80f9-83b063d1b520', '746648e5-cac1-4d9a-ba86-1b22844be5b1'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Created reservations ['ab88db39-250e-4320-986a-17fbcc974eba', '4328f874-40da-40f6-84a7-9ce43e1bde30', '4b2910cd-a195-4dc7-9adb-a82810cd3697', 'b4a7bb69-d082-4f07-9a2a-ec2c037753d2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Delete snapshot completed successfully. Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d2946290-b6e1-44ea-a039-aa103de7e464 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-0422e0ca-39e2-41f8-94d8-832320ab1112-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:52 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:52 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:52 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.357s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:52 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:59:52 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Deleted volume successfully. Sep 28 15:59:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-31a82742-5ea3-40a5-9a4c-620f71f64caf tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "cinder-6822f8f9-55fd-4c46-8a94-5d3609337254-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Creating offline snapshot 562f8109-0fee-4534-bafc-ea179a5403d7 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e3362-21c1-41d1-b7e2-441e36264bcf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-06251769-525d-47b7-ac7a-78487008d155 req-6e14c8ad-eccd-4166-a49b-1da89bc71054 tempest-ServerActionsTestOtherA-1827865301 None] Terminate volume connection completed successfully. Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-06251769-525d-47b7-ac7a-78487008d155 req-6e14c8ad-eccd-4166-a49b-1da89bc71054 tempest-ServerActionsTestOtherA-1827865301 None] Deleting attachment d015f3f2-616b-4118-a6b8-158749858163. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:59:53 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 15:59:53 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Flow 'volume_create_manager' (eb4e2798-86ea-42d6-85ac-1e360961a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0e0278-5280-4e9e-af13-5068018dd474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0e0278-5280-4e9e-af13-5068018dd474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075714314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4f7668-409b-4738-9787-164a4ff9ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20322db2a8bc4191809182a9e2408d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:53Z,use_quota=True,user_id='54380aac055145a8b7296470b6baea58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28591470-8eff-4bbe-a251-e2e1c44911fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28591470-8eff-4bbe-a251-e2e1c44911fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394cdf49-9032-48ba-82c5-38b2ec9b8015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394cdf49-9032-48ba-82c5-38b2ec9b8015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4f7668-409b-4738-9787-164a4ff9ed02', 'volume_name': 'volume-bc4f7668-409b-4738-9787-164a4ff9ed02', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c35cdd7-e1e7-4254-9ceb-6ae2bd8cee06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c35cdd7-e1e7-4254-9ceb-6ae2bd8cee06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4534d92a-330e-45d4-a9e2-123de3d391ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:53 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Volume bc4f7668-409b-4738-9787-164a4ff9ed02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4f7668-409b-4738-9787-164a4ff9ed02', 'volume_size': 1} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:53 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.592s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:53 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 1G Sep 28 15:59:53 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:54 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 1G" returned: 0 in 0.527s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:54 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 Sep 28 15:59:54 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:54 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:54 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 is being set with open permissions: ugo+rw Sep 28 15:59:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:54 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 Sep 28 15:59:54 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:54 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7" returned: 0 in 0.334s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1075714314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4f7668-409b-4738-9787-164a4ff9ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20322db2a8bc4191809182a9e2408d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:53Z,use_quota=True,user_id='54380aac055145a8b7296470b6baea58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Creating volume bc4f7668-409b-4738-9787-164a4ff9ed02 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:55 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:55 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 1073741824 Sep 28 15:59:55 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-82a1ba91-fcf3-481d-b889-39ff3f8daac2 tempest-SnapshotsActionsTest-1457458162 None] Create snapshot completed successfully Sep 28 15:59:55 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 1073741824" returned: 0 in 0.797s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:55 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 Sep 28 15:59:55 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-562f8109-0fee-4534-bafc-ea179a5403d7-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-562f8109-0fee-4534-bafc-ea179a5403d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:56 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02" returned: 0 in 0.531s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-562f8109-0fee-4534-bafc-ea179a5403d7" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4534d92a-330e-45d4-a9e2-123de3d391ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4f7668-409b-4738-9787-164a4ff9ed02', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dd5e33-65c0-4841-bc14-4d7a072b5932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-562f8109-0fee-4534-bafc-ea179a5403d7" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Deleting offline snapshot 562f8109-0fee-4534-bafc-ea179a5403d7 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] snapshot_file for this snap is: volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a49e8cc-6071-4f56-b97f-19b4d3c8fe49]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Volume volume-bc4f7668-409b-4738-9787-164a4ff9ed02 (bc4f7668-409b-4738-9787-164a4ff9ed02): created successfully Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dd5e33-65c0-4841-bc14-4d7a072b5932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Flow 'volume_create_manager' (eb4e2798-86ea-42d6-85ac-1e360961a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c7f521ab-802f-465c-8ad4-5b42875ed580 tempest-VolumeQuotasAdminTestJSON-960842059 None] Created volume successfully. Sep 28 15:59:56 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 Sep 28 15:59:56 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Flow 'volume_create_manager' (d51b6916-7553-4858-8b22-c485ee4151d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbc564a-1876-4135-8249-44ea7f3904bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbc564a-1876-4135-8249-44ea7f3904bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-582879862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60216a44-f84a-4c85-bb55-ff1d9a627521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06efdc9da8248ec94010916a37e5587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:57Z,use_quota=True,user_id='42dca72957db44149139f92df32ef540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391d346-98b4-4692-adca-2ec07c5a6d5c),volume_type_id=3391d346-98b4-4692-adca-2ec07c5a6d5c)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e870c8b-c92b-451c-9cc5-7123c6f4b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e870c8b-c92b-451c-9cc5-7123c6f4b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5ab265-5707-4ebf-a7cb-f4400e8ba514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5ab265-5707-4ebf-a7cb-f4400e8ba514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60216a44-f84a-4c85-bb55-ff1d9a627521', 'volume_name': 'volume-60216a44-f84a-4c85-bb55-ff1d9a627521', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ca112f-8443-4aa8-94e6-43edc451dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ca112f-8443-4aa8-94e6-43edc451dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6209d31f-f4f3-4f50-808c-325a790dad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Volume 60216a44-f84a-4c85-bb55-ff1d9a627521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60216a44-f84a-4c85-bb55-ff1d9a627521', 'volume_size': 1} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-582879862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60216a44-f84a-4c85-bb55-ff1d9a627521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06efdc9da8248ec94010916a37e5587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:59:57Z,use_quota=True,user_id='42dca72957db44149139f92df32ef540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3391d346-98b4-4692-adca-2ec07c5a6d5c),volume_type_id=3391d346-98b4-4692-adca-2ec07c5a6d5c)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Creating volume 60216a44-f84a-4c85-bb55-ff1d9a627521 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:59:56 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 15:59:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:56 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 1073741824 Sep 28 15:59:56 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:57 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7" returned: 0 in 0.562s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4621f5f9-4fd3-4fa8-83b1-ff17939aa8e6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:57 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 15:59:57 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:57 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 1073741824" returned: 0 in 0.755s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:57 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 Sep 28 15:59:57 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:57 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.651s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:59:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:57 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 Sep 28 15:59:57 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e559899f-2df3-4f26-98ed-21a29c35ecb0 tempest-VolumeQuotasAdminTestJSON-380719817 None] Transfer volume completed successfully. Sep 28 15:59:58 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521" returned: 0 in 0.373s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6209d31f-f4f3-4f50-808c-325a790dad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60216a44-f84a-4c85-bb55-ff1d9a627521', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3197e7-57dc-42f5-829f-b0331e9a7b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:59:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Volume volume-60216a44-f84a-4c85-bb55-ff1d9a627521 (60216a44-f84a-4c85-bb55-ff1d9a627521): created successfully Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3197e7-57dc-42f5-829f-b0331e9a7b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Flow 'volume_create_manager' (d51b6916-7553-4858-8b22-c485ee4151d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:59:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2cd0973c-e030-4a54-b4cd-95bea9690a83 tempest-VolumeTypesAccessTest-1748935013 None] Created volume successfully. Sep 28 15:59:58 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7" returned: 0 in 0.547s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:58 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7 Sep 28 15:59:58 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Acquiring lock "cinder-bc4f7668-409b-4738-9787-164a4ff9ed02-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Lock "cinder-bc4f7668-409b-4738-9787-164a4ff9ed02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Acquiring lock "cinder-quobyte-bc4f7668-409b-4738-9787-164a4ff9ed02" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:58 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.562f8109-0fee-4534-bafc-ea179a5403d7" returned: 0 in 0.312s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Lock "cinder-quobyte-bc4f7668-409b-4738-9787-164a4ff9ed02" acquired by "delete_volume" :: waited 0.055s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-562f8109-0fee-4534-bafc-ea179a5403d7" released by "_delete_snapshot" :: held 2.271s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" released by "delete_snapshot" :: held 2.322s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf25ca6-f0bf-4844-b6c4-dd72b6338090]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Created reservations ['d10843d3-ffd7-4020-b6f3-c25d78522bf1', 'bbb85ee2-ad3d-4de5-96bb-616e438a586f', '138e2d4e-edf3-4a48-9647-7163e0455b3d', 'ff312b1e-44fc-4910-9f09-93d4066b2cb9'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:58 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 Sep 28 15:59:58 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Delete snapshot completed successfully. Sep 28 15:59:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8188ae6a-64f7-458d-8eec-443fce479aa9 tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-562f8109-0fee-4534-bafc-ea179a5403d7-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Acquiring lock "cinder-60216a44-f84a-4c85-bb55-ff1d9a627521-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Lock "cinder-60216a44-f84a-4c85-bb55-ff1d9a627521-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Acquiring lock "cinder-quobyte-60216a44-f84a-4c85-bb55-ff1d9a627521" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Lock "cinder-quobyte-60216a44-f84a-4c85-bb55-ff1d9a627521" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d314fde-7c9f-4f90-a14b-79edce98e653]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:59 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02" returned: 0 in 0.533s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:59 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02 Sep 28 15:59:59 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:59 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 Sep 28 15:59:59 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:59 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bc4f7668-409b-4738-9787-164a4ff9ed02" returned: 0 in 0.288s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Lock "cinder-quobyte-bc4f7668-409b-4738-9787-164a4ff9ed02" released by "delete_volume" :: held 0.893s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Created reservations ['5310b8ca-926d-43b4-9cc3-bf70be9f3874', '919b3f83-999e-4a6c-a047-4fc2f61af9df', 'f565f2fe-b80c-433b-b0ca-f4b20bb0b81b', '605caa3a-3d5d-4f47-90c3-e60654b91b0e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:59:59 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521" returned: 0 in 0.481s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:59 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521 Sep 28 15:59:59 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:59:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:59 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 15:59:59 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:00 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Creating offline snapshot ced0743e-06fc-44b1-a7af-df121632e457 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-60216a44-f84a-4c85-bb55-ff1d9a627521" returned: 0 in 0.630s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:00 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.547s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Lock "cinder-quobyte-60216a44-f84a-4c85-bb55-ff1d9a627521" released by "delete_volume" :: held 1.192s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01470a-80a5-4cf1-825f-ce9f881eedce]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:00 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Deleted volume successfully. Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ed329e42-52a5-42ea-a964-e3c2a7b4a509 tempest-VolumeQuotasAdminTestJSON-29538468 None] Lock "cinder-bc4f7668-409b-4738-9787-164a4ff9ed02-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:00 devstack cinder-volume[86628]: WARNING cinder.quota [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-348732101 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-348732101, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:00:00 devstack cinder-volume[86628]: WARNING cinder.quota [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-348732101 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-348732101, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Created reservations ['b80b58fe-c76b-412b-8b67-1cc5ce545c01', '33bdbfbc-d29a-4e0e-9e71-7ebea6605176', '631d7b6e-8656-49ab-a0a7-7646b1c58ea1', '5ece279e-9956-4aa1-be20-f7a1c85f23fa'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:00 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:00 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:00 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:00 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:00 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.442s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:00 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 1G Sep 28 16:00:00 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:00 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.361s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:00 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:00 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Deleted volume successfully. Sep 28 16:00:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-56dd0223-8929-43fe-82b0-1cb3fbef2bdd tempest-VolumeTypesAccessTest-1748935013 None] Lock "cinder-60216a44-f84a-4c85-bb55-ff1d9a627521-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:01 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 1G" returned: 0 in 0.688s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:01 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 Sep 28 16:00:01 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:01 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457" returned: 0 in 0.456s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:01 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 is being set with open permissions: ugo+rw Sep 28 16:00:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:01 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 Sep 28 16:00:01 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:02 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457" returned: 0 in 0.412s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-11c5f6d0-831d-44cf-b18c-4ef1301b1d8e tempest-SnapshotsActionsTest-1457458162 None] Create snapshot completed successfully Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Flow 'volume_create_manager' (c814c19c-f043-477e-a692-4e6555e8194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7649277d-125d-4713-b70f-5ab4a33ebe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7649277d-125d-4713-b70f-5ab4a33ebe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-245253379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27897c8e-a4a0-4862-b0dc-6dbf52aecfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01109cc610a43ad952a6ce6298dc7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:03Z,use_quota=True,user_id='71723b30312943929be6abac308f0840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3924d4-d0f4-48fe-b542-e2c1013092e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3924d4-d0f4-48fe-b542-e2c1013092e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1a7795-d575-4347-ae92-5fa361752251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:02 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-ced0743e-06fc-44b1-a7af-df121632e457-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-ced0743e-06fc-44b1-a7af-df121632e457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-ced0743e-06fc-44b1-a7af-df121632e457" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-ced0743e-06fc-44b1-a7af-df121632e457" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Deleting offline snapshot ced0743e-06fc-44b1-a7af-df121632e457 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] snapshot_file for this snap is: volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d454a7-4ced-4860-859f-e9c324f9fa03]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:03 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 Sep 28 16:00:03 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1a7795-d575-4347-ae92-5fa361752251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27897c8e-a4a0-4862-b0dc-6dbf52aecfb4', 'volume_name': 'volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c1f5c9-8710-41b3-9a1d-14de3f0e347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c1f5c9-8710-41b3-9a1d-14de3f0e347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f1887e-8cc7-479d-af7c-ab4a2d8a92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Volume 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:00:03 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Trying to clone 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:00:04 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457" returned: 0 in 0.576s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[405710c3-7814-43b2-b630-eedbdae3967d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:00:04 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:00:04 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:04 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0f731-eb9e-4155-9ff3-aa21da5fe39e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:04 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD Sep 28 16:00:04 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:04 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.640s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:04 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 Sep 28 16:00:04 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:05 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 is fetched for user 71723b30312943929be6abac308f0840. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[56de01f8-e4f7-4119-9d38-96379d9c125c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:05 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD Sep 28 16:00:05 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:05 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457" returned: 0 in 0.597s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:05 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457 Sep 28 16:00:05 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:05 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-245253379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27897c8e-a4a0-4862-b0dc-6dbf52aecfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01109cc610a43ad952a6ce6298dc7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:03Z,use_quota=True,user_id='71723b30312943929be6abac308f0840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Creating volume 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:05 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 1073741824 Sep 28 16:00:05 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:06 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.ced0743e-06fc-44b1-a7af-df121632e457" returned: 0 in 0.477s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-ced0743e-06fc-44b1-a7af-df121632e457" released by "_delete_snapshot" :: held 2.482s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" released by "delete_snapshot" :: held 2.518s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Created reservations ['8d3a037d-ab1e-4e52-906c-d646448e66ce', 'dbf54df0-44b4-438a-b83a-053c513d0785', '4ccc2848-c1ee-4106-ab83-657e5c764d88', '99a70f4d-724a-48bf-9b75-145331c6ab23'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Delete snapshot completed successfully. Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cff90e4b-a17a-4fd7-9130-ddc76b841a5e tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-ced0743e-06fc-44b1-a7af-df121632e457-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:06 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 1073741824" returned: 0 in 0.731s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:06 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 Sep 28 16:00:06 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:06 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Attempting download of dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c5d241-3d2b-4cac-b0b8-668259b4b688]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:07 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54 Sep 28 16:00:07 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Creating offline snapshot 7f7be8cd-5e09-4d9d-8950-1eca2daa5307 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[83685a92-d82a-477c-bee2-f2e622746997]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:07 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:07 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:07 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:07 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54 Sep 28 16:00:07 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:08 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.515s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:08 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 1G Sep 28 16:00:08 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:08 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54" returned: 1 in 0.528s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_loalbk54' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[742e859d-0b52-4228-8781-cf145c7c50e5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:08 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD Sep 28 16:00:08 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:08 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 was qcow2, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:08 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 Sep 28 16:00:08 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:08 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 1G" returned: 0 in 0.666s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:08 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 Sep 28 16:00:08 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:09 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:09 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 is being set with open permissions: ugo+rw Sep 28 16:00:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:09 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 Sep 28 16:00:09 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:09 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:09 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-828a3b99-7996-40dd-af8a-dd37b9295e97 tempest-SnapshotsActionsTest-1457458162 None] Create snapshot completed successfully Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-7f7be8cd-5e09-4d9d-8950-1eca2daa5307-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-7f7be8cd-5e09-4d9d-8950-1eca2daa5307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Acquiring lock "cinder-quobyte-7f7be8cd-5e09-4d9d-8950-1eca2daa5307" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-7f7be8cd-5e09-4d9d-8950-1eca2daa5307" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Deleting offline snapshot 7f7be8cd-5e09-4d9d-8950-1eca2daa5307 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] snapshot_file for this snap is: volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103a88c-ef0f-4c5b-bdca-6ab6bdc931ba]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:11 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 Sep 28 16:00:11 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:11 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" returned: 0 in 2.897s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_qpskbucudevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:00:11 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Converted 112.00 MB image at 38.64 MB/s Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:11 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307" returned: 0 in 0.565s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:11 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 1G Sep 28 16:00:11 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[96307911-2263-4643-98f9-24321c8d74c5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:11 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:11 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:11 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 1G" returned: 0 in 0.429s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Downloaded image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 for user 71723b30312943929be6abac308f0840 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Marking volume 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Copying metadata from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 to 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:00:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Creating volume glance metadata for volume 27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 backed by image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f1887e-8cc7-479d-af7c-ab4a2d8a92f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7477ee2-42fa-432f-9011-ed11814fcb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Volume volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 (27897c8e-a4a0-4862-b0dc-6dbf52aecfb4): created successfully Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7477ee2-42fa-432f-9011-ed11814fcb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Flow 'volume_create_manager' (c814c19c-f043-477e-a692-4e6555e8194b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.560s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-dad63fb7-a1a9-40ee-8e9a-35e87b5850c3 tempest-ServerActionsTestOtherA-1827865301 None] Created volume successfully. Sep 28 16:00:12 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 Sep 28 16:00:12 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:12 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Flow 'volume_create_manager' (47842093-bac4-42b0-abdd-e0908ba29e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694a57d2-0fae-4606-a140-7652ac576d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307" returned: 0 in 0.619s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694a57d2-0fae-4606-a140-7652ac576d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1652437688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5dfaf5-24df-46b9-a013-2c3838821841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb6c57ce86648069223d0d6bb9b6b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:13Z,use_quota=True,user_id='ed30cc56e5504d11b48fb8ea7a68169e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9036502e-aa14-43b3-be22-4c924780fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307 Sep 28 16:00:12 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9036502e-aa14-43b3-be22-4c924780fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db4429-489a-4819-bf7f-3500f7cde5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7db4429-489a-4819-bf7f-3500f7cde5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5dfaf5-24df-46b9-a013-2c3838821841', 'volume_name': 'volume-0a5dfaf5-24df-46b9-a013-2c3838821841', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667bd1bc-abf9-4b9e-8a20-1b1c15bf5650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667bd1bc-abf9-4b9e-8a20-1b1c15bf5650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58dc559-223a-4a9d-870c-3542ba300dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Volume 0a5dfaf5-24df-46b9-a013-2c3838821841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5dfaf5-24df-46b9-a013-2c3838821841', 'volume_size': 1} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1652437688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5dfaf5-24df-46b9-a013-2c3838821841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb6c57ce86648069223d0d6bb9b6b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:13Z,use_quota=True,user_id='ed30cc56e5504d11b48fb8ea7a68169e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Creating volume 0a5dfaf5-24df-46b9-a013-2c3838821841 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:12 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:12 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 1073741824 Sep 28 16:00:12 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Flow 'volume_create_manager' (5e4b0fd4-3975-4eae-af1e-8cd1fa8471c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f77bba8-d534-4954-b225-7369ac8ee782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f77bba8-d534-4954-b225-7369ac8ee782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382327181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df64fde5339243c0a982692a46b812f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:13Z,use_quota=True,user_id='6ff6793483f64aaab7917551b1576aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b24457-dc82-495a-bd5e-db4c84aca40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b24457-dc82-495a-bd5e-db4c84aca40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39eba2ba-0565-4f2d-8a87-b8d99df8681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39eba2ba-0565-4f2d-8a87-b8d99df8681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a', 'volume_name': 'volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce09f5b-1991-4d0e-8d31-e1181e944aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce09f5b-1991-4d0e-8d31-e1181e944aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5171178c-3e4b-49e8-ab99-cfbebacca649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Volume c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a', 'volume_size': 1} Sep 28 16:00:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:13 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.7f7be8cd-5e09-4d9d-8950-1eca2daa5307" returned: 0 in 0.423s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-7f7be8cd-5e09-4d9d-8950-1eca2daa5307" released by "_delete_snapshot" :: held 2.311s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" released by "delete_snapshot" :: held 2.345s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Created reservations ['ba034799-373a-4982-b770-3a35d2f31c88', 'b347aca0-1930-4c33-a57b-3b1c4642a01d', 'e218fc41-70d7-4d12-a93d-2eedc3d0a68e', 'e237609e-6d16-414e-9009-502ad44a8470'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Delete snapshot completed successfully. Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9c173f2e-fba9-4c13-bf23-f1b3536bf90d tempest-SnapshotsActionsTest-1447743895 None] Lock "cinder-7f7be8cd-5e09-4d9d-8950-1eca2daa5307-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:13 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 1073741824" returned: 0 in 0.598s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:13 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 Sep 28 16:00:13 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:13 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841" returned: 0 in 0.283s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382327181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df64fde5339243c0a982692a46b812f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:13Z,use_quota=True,user_id='6ff6793483f64aaab7917551b1576aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Creating volume c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:13 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:13 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a 1073741824 Sep 28 16:00:13 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58dc559-223a-4a9d-870c-3542ba300dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5dfaf5-24df-46b9-a013-2c3838821841', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0481a19-f607-4800-92a7-a39b809a7b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Volume volume-0a5dfaf5-24df-46b9-a013-2c3838821841 (0a5dfaf5-24df-46b9-a013-2c3838821841): created successfully Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0481a19-f607-4800-92a7-a39b809a7b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Flow 'volume_create_manager' (47842093-bac4-42b0-abdd-e0908ba29e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c46aa2b7-1bb0-48a6-845c-c99121641114 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Created volume successfully. Sep 28 16:00:14 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a 1073741824" returned: 0 in 0.641s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:14 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a Sep 28 16:00:14 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "cinder-106a278f-0884-4770-9040-1dd1965261a9-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-106a278f-0884-4770-9040-1dd1965261a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "cinder-quobyte-106a278f-0884-4770-9040-1dd1965261a9" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-quobyte-106a278f-0884-4770-9040-1dd1965261a9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Deleting offline snapshot 106a278f-0884-4770-9040-1dd1965261a9 of volume 9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:00:14 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] snapshot_file for this snap is: volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a" returned: 0 in 0.434s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5171178c-3e4b-49e8-ab99-cfbebacca649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ca27f6-a638-4ef8-9433-ac91fbeb61c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[881b314b-a781-4fd7-a3d1-607b67e541b9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:14 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Volume volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a (c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a): created successfully Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ca27f6-a638-4ef8-9433-ac91fbeb61c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Flow 'volume_create_manager' (5e4b0fd4-3975-4eae-af1e-8cd1fa8471c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5d3043ba-c1ae-4139-a044-7cf01504b123 tempest-VolumesListAdminTestJSON-1389714852 None] Created volume successfully. Sep 28 16:00:15 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:15 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:15 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.583s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f60db25-a2fc-4791-bb10-b609d686c726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:00:15 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa7c39-0f62-47ce-b8cb-6e495ada7e32]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:15 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 Sep 28 16:00:15 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:16 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726" returned: 0 in 0.549s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:16 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:16 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Acquiring lock "cinder-0a5dfaf5-24df-46b9-a013-2c3838821841-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "cinder-0a5dfaf5-24df-46b9-a013-2c3838821841-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Acquiring lock "cinder-quobyte-0a5dfaf5-24df-46b9-a013-2c3838821841" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "cinder-quobyte-0a5dfaf5-24df-46b9-a013-2c3838821841" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbca2fe7-a715-4072-a76b-bc516c6fe042]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:16 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 Sep 28 16:00:16 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:17 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.904s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:17 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9 Sep 28 16:00:17 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0774d530-ce10-4d34-a187-9943049aad35 req-0d986d51-da62-4c60-96a9-010327049d5d tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0774d530-ce10-4d34-a187-9943049aad35 req-0d986d51-da62-4c60-96a9-010327049d5d tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0774d530-ce10-4d34-a187-9943049aad35 req-0d986d51-da62-4c60-96a9-010327049d5d tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:17 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Flow 'volume_create_manager' (dc7d89da-43ce-440a-98d2-f0c53438448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6633a4de-83d3-45cd-a821-de0949b617f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-0774d530-ce10-4d34-a187-9943049aad35 req-0d986d51-da62-4c60-96a9-010327049d5d tempest-ServerActionsTestOtherA-1827865301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d254655-6d85-4280-83e9-16e8f1ed94a5', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841" returned: 0 in 0.656s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6633a4de-83d3-45cd-a821-de0949b617f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-859898599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709ee672-0063-4807-bb4b-6393b3cbc4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df64fde5339243c0a982692a46b812f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:17Z,use_quota=True,user_id='6ff6793483f64aaab7917551b1576aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:17 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841 Sep 28 16:00:17 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c12e623-54ef-48f6-a4f6-5da972432255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c12e623-54ef-48f6-a4f6-5da972432255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6d7ecf-5519-4e24-9760-75c006d58f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6d7ecf-5519-4e24-9760-75c006d58f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709ee672-0063-4807-bb4b-6393b3cbc4bb', 'volume_name': 'volume-709ee672-0063-4807-bb4b-6393b3cbc4bb', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79604509-ca51-4442-a639-5bfd027812e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79604509-ca51-4442-a639-5bfd027812e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b051d1-e806-46fd-8510-96f95ef42895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:17 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Volume 709ee672-0063-4807-bb4b-6393b3cbc4bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709ee672-0063-4807-bb4b-6393b3cbc4bb', 'volume_size': 1} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-859898599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709ee672-0063-4807-bb4b-6393b3cbc4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df64fde5339243c0a982692a46b812f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:17Z,use_quota=True,user_id='6ff6793483f64aaab7917551b1576aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Creating volume 709ee672-0063-4807-bb4b-6393b3cbc4bb {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:17 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:17 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb 1073741824 Sep 28 16:00:17 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:17 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726.106a278f-0884-4770-9040-1dd1965261a9" returned: 0 in 0.496s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-0774d530-ce10-4d34-a187-9943049aad35 req-0d986d51-da62-4c60-96a9-010327049d5d tempest-ServerActionsTestOtherA-1827865301 None] attachment_update completed successfully. Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-quobyte-106a278f-0884-4770-9040-1dd1965261a9" released by "_delete_snapshot" :: held 2.806s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" released by "delete_snapshot" :: held 2.847s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Created reservations ['40615f1f-a1da-44bc-a616-49b0fea50004', 'e11c7484-b5c8-41ac-beb4-5c39d4c3362e', '6eff5d30-53d8-46c7-87ec-e24a6a033c4f', '6494c43b-4d8d-4e20-a47e-a5d98c1856c8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:17 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a5dfaf5-24df-46b9-a013-2c3838821841" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "cinder-quobyte-0a5dfaf5-24df-46b9-a013-2c3838821841" released by "delete_volume" :: held 1.276s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Delete snapshot completed successfully. Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c3aa4521-f1e2-45fe-b72d-a5d1872f3977 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-106a278f-0884-4770-9040-1dd1965261a9-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Created reservations ['1536c872-0c06-4949-a5c5-2d25c6f97a47', 'c9adcffa-bdb9-4f5b-a74d-487a2669681f', '9f582daa-b07d-4765-a916-3fa22ddd638c', '3292f7b2-242e-4980-a3a7-0e3e6ded971d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "cinder-9f60db25-a2fc-4791-bb10-b609d686c726-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:18 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:18 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-9f60db25-a2fc-4791-bb10-b609d686c726-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:18 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb 1073741824" returned: 0 in 1.010s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:18 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb Sep 28 16:00:18 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ddb69-e716-4493-990a-cab112918b83]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:18 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.405s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Deleted volume successfully. Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68224765-35cf-42b7-b4b6-bc20b9fb1379 tempest-VolumeQuotasNegativeTestJSON-1411258622 None] Lock "cinder-0a5dfaf5-24df-46b9-a013-2c3838821841-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:18 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 Sep 28 16:00:18 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:18 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb" returned: 0 in 0.352s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b051d1-e806-46fd-8510-96f95ef42895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709ee672-0063-4807-bb4b-6393b3cbc4bb', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c42391-77e6-478b-ace5-98d4a30fdcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:18 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Volume volume-709ee672-0063-4807-bb4b-6393b3cbc4bb (709ee672-0063-4807-bb4b-6393b3cbc4bb): created successfully Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c42391-77e6-478b-ace5-98d4a30fdcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Flow 'volume_create_manager' (dc7d89da-43ce-440a-98d2-f0c53438448c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ba3b3094-f53b-45ee-8b65-3fccd74b5d0b tempest-VolumesListAdminTestJSON-1389714852 None] Created volume successfully. Sep 28 16:00:19 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726" returned: 0 in 0.570s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:19 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726 Sep 28 16:00:19 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:19 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9f60db25-a2fc-4791-bb10-b609d686c726" returned: 0 in 0.438s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-quobyte-9f60db25-a2fc-4791-bb10-b609d686c726" released by "delete_volume" :: held 1.120s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Created reservations ['92407f33-ed83-4d2c-8912-5b7eb74c1cd2', 'b25362ff-7eb1-407d-8b26-053daf53076e', '86b0285a-f823-4a9b-bfb3-ace8319319c5', 'a5bddfa8-3a79-4a89-a3b2-23445fa504f0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:20 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:20 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:20 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Flow 'volume_create_manager' (2c05b81b-4037-4947-8cbe-196ab36828ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6aa046-3f35-45ec-a8c7-10a3cce09fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.557s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Deleted volume successfully. Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6aa046-3f35-45ec-a8c7-10a3cce09fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1616590145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0518c044-48d9-4636-bb7f-d2f8d500eca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df64fde5339243c0a982692a46b812f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:20Z,use_quota=True,user_id='6ff6793483f64aaab7917551b1576aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac348cf-6f30-4ad3-b4e6-025c8a1f46f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac348cf-6f30-4ad3-b4e6-025c8a1f46f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb951b4-880b-43ed-9be2-71db7b69fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb951b4-880b-43ed-9be2-71db7b69fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0518c044-48d9-4636-bb7f-d2f8d500eca1', 'volume_name': 'volume-0518c044-48d9-4636-bb7f-d2f8d500eca1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b319f92-9cf4-4e2c-af5a-1c09b50f674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b319f92-9cf4-4e2c-af5a-1c09b50f674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bbd301-b0f5-4f45-a138-1e6db3861dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:20 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Volume 0518c044-48d9-4636-bb7f-d2f8d500eca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0518c044-48d9-4636-bb7f-d2f8d500eca1', 'volume_size': 1} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1616590145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0518c044-48d9-4636-bb7f-d2f8d500eca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df64fde5339243c0a982692a46b812f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:20Z,use_quota=True,user_id='6ff6793483f64aaab7917551b1576aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Creating volume 0518c044-48d9-4636-bb7f-d2f8d500eca1 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:20 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:20 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 1073741824 Sep 28 16:00:20 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7b95cd62-2bde-4d2e-978e-9d906ee9e1e7 tempest-SnapshotsActionsTest-1457458162 None] Lock "cinder-9f60db25-a2fc-4791-bb10-b609d686c726-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:21 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 1073741824" returned: 0 in 0.969s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:21 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 Sep 28 16:00:21 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:22 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1" returned: 0 in 0.585s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bbd301-b0f5-4f45-a138-1e6db3861dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0518c044-48d9-4636-bb7f-d2f8d500eca1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d3a23-0548-4fe5-84e8-15f318cf571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:22 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Volume volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 (0518c044-48d9-4636-bb7f-d2f8d500eca1): created successfully Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d3a23-0548-4fe5-84e8-15f318cf571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Flow 'volume_create_manager' (2c05b81b-4037-4947-8cbe-196ab36828ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-48d1337c-0233-4da7-87f3-d05ec974b472 tempest-VolumesListAdminTestJSON-1389714852 None] Created volume successfully. Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Flow 'volume_create_manager' (6873e38a-d8a6-4210-b1fa-096670c824d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d50a3e-1109-4bc4-89a6-d7dc670eedf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d50a3e-1109-4bc4-89a6-d7dc670eedf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7591bd2a3276474993cc9ef874c3eebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:24Z,use_quota=True,user_id='368c55fe04d344c29e5a338b631f1e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95acb114-f4b1-4f93-825f-73d2c00e0074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95acb114-f4b1-4f93-825f-73d2c00e0074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2c609b-3173-45b9-864b-3d45791b90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2c609b-3173-45b9-864b-3d45791b90ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb', 'volume_name': 'volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4549df51-73f9-488d-a787-f8c99d7c0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4549df51-73f9-488d-a787-f8c99d7c0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e598a0c2-12b0-41b4-9366-ccf2660a6c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:24 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Volume 6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb', 'volume_size': 1} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7591bd2a3276474993cc9ef874c3eebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:24Z,use_quota=True,user_id='368c55fe04d344c29e5a338b631f1e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Creating volume 6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:24 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:24 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb 1073741824 Sep 28 16:00:24 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:25 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb 1073741824" returned: 0 in 0.740s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:25 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb Sep 28 16:00:25 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:26 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb" returned: 0 in 0.638s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e598a0c2-12b0-41b4-9366-ccf2660a6c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f37454e-93aa-450d-b9a5-fc5c821e0410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:26 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Volume volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb (6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb): created successfully Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f37454e-93aa-450d-b9a5-fc5c821e0410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Flow 'volume_create_manager' (6873e38a-d8a6-4210-b1fa-096670c824d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6761e109-909d-431f-a31a-300ef8900606 tempest-VolumesListAdminTestJSON-164420928 None] Created volume successfully. Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:26 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:26 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Acquiring lock "cinder-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Lock "cinder-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Acquiring lock "cinder-quobyte-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Lock "cinder-quobyte-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a318924b-1254-4ee4-9962-ffda6798ff7e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:27 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "cinder-0518c044-48d9-4636-bb7f-d2f8d500eca1-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.543s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-0518c044-48d9-4636-bb7f-d2f8d500eca1-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:27 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb Sep 28 16:00:27 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "cinder-quobyte-0518c044-48d9-4636-bb7f-d2f8d500eca1" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-quobyte-0518c044-48d9-4636-bb7f-d2f8d500eca1" acquired by "delete_volume" :: waited 0.070s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3174b72c-31d4-4f40-aece-e804f7cd9716]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:27 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 Sep 28 16:00:27 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:28 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb" returned: 0 in 0.798s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:28 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb Sep 28 16:00:28 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:28 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1" returned: 0 in 0.752s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:28 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1 Sep 28 16:00:28 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:28 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb" returned: 0 in 0.555s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Lock "cinder-quobyte-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb" released by "delete_volume" :: held 1.477s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Created reservations ['05fbe27b-41aa-4d33-a77c-0679ec94010f', 'cc275964-d670-4b65-a988-289e549149d2', '908bd17a-989c-4242-98aa-7cada4a4d074', 'f785e0bd-7595-4a6f-98ca-7690eae21334'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:28 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0518c044-48d9-4636-bb7f-d2f8d500eca1" returned: 0 in 0.623s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-quobyte-0518c044-48d9-4636-bb7f-d2f8d500eca1" released by "delete_volume" :: held 1.522s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:29 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:29 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Created reservations ['f9c43ad3-b116-4fd2-be4d-f50c8c938a01', '8c14e14c-adeb-47f1-bacc-dda09d54e845', 'a2708ead-fa24-4809-8f37-bb79ba3e11f3', '825b58e5-9e1e-44e9-b6ac-dedf99218dd0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:29 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:29 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:29 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.765s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Deleted volume successfully. Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-467cdecd-8d31-4cab-aece-309da2eb2daf tempest-VolumesListAdminTestJSON-164420928 None] Lock "cinder-6543d1d2-c375-44f0-97ac-2ef1f3a8e0eb-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:29 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.509s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:29 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Deleted volume successfully. Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-49e2fcfe-010f-40fe-9cd3-b60d8384bf7b tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-0518c044-48d9-4636-bb7f-d2f8d500eca1-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "cinder-709ee672-0063-4807-bb4b-6393b3cbc4bb-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-709ee672-0063-4807-bb4b-6393b3cbc4bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "cinder-quobyte-709ee672-0063-4807-bb4b-6393b3cbc4bb" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-quobyte-709ee672-0063-4807-bb4b-6393b3cbc4bb" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f413dbf-9067-488f-90f9-48600d26b1af]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:30 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb Sep 28 16:00:30 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:31 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb" returned: 0 in 0.688s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:31 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb Sep 28 16:00:31 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:31 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-709ee672-0063-4807-bb4b-6393b3cbc4bb" returned: 0 in 0.621s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-quobyte-709ee672-0063-4807-bb4b-6393b3cbc4bb" released by "delete_volume" :: held 1.397s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Created reservations ['fceb1a9d-4e95-4b60-8992-cf8931d61aae', '6fcb6c71-b829-48b0-8820-52330ed5480d', 'bf81e866-259f-48ce-a5ec-11e822a91406', 'ebfb13dd-0eaa-4e5b-809e-cfc7763d80b5'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:32 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:32 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:33 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.662s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Deleted volume successfully. Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d696fef7-91e8-4c38-8be1-d0548a64159a tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-709ee672-0063-4807-bb4b-6393b3cbc4bb-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "cinder-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "cinder-quobyte-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-quobyte-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e58e55-8912-4432-b0cb-4b233517c5e7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:33 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a Sep 28 16:00:33 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Flow 'volume_create_manager' (2700e5f9-c86f-4e7e-ad49-c4755f4a42d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f81b7be-b806-470a-b1ef-4f9f265e3e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f81b7be-b806-470a-b1ef-4f9f265e3e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1447462162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f46082-b744-4322-ae8b-62e0002b2aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71fcd55726c4ffbbc5c7e50935b546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:34Z,use_quota=True,user_id='7435ba4d53ea42ae9ca5a2cdb39d6326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ac37c5c-f31a-4b97-98db-7d5f94bb0756),volume_type_id=1ac37c5c-f31a-4b97-98db-7d5f94bb0756)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863d5dd8-fe5f-4242-80bc-ab305a4fb183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863d5dd8-fe5f-4242-80bc-ab305a4fb183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fd4188-4391-4799-8dbd-c00c107c6d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fd4188-4391-4799-8dbd-c00c107c6d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f46082-b744-4322-ae8b-62e0002b2aab', 'volume_name': 'volume-43f46082-b744-4322-ae8b-62e0002b2aab', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d251bf-325e-4ca7-895e-b815801c7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d251bf-325e-4ca7-895e-b815801c7602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cc075a-b09d-432c-bcca-811bd034d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:34 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Volume 43f46082-b744-4322-ae8b-62e0002b2aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f46082-b744-4322-ae8b-62e0002b2aab', 'volume_size': 1} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1447462162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f46082-b744-4322-ae8b-62e0002b2aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71fcd55726c4ffbbc5c7e50935b546c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:34Z,use_quota=True,user_id='7435ba4d53ea42ae9ca5a2cdb39d6326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ac37c5c-f31a-4b97-98db-7d5f94bb0756),volume_type_id=1ac37c5c-f31a-4b97-98db-7d5f94bb0756)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Creating volume 43f46082-b744-4322-ae8b-62e0002b2aab {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:34 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:34 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab 1073741824 Sep 28 16:00:34 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:34 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a" returned: 0 in 0.968s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:34 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a Sep 28 16:00:34 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:35 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a" returned: 0 in 0.529s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-quobyte-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a" released by "delete_volume" :: held 1.567s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Created reservations ['c9ad35e3-c7fe-42d9-9c11-e5165b544fcd', '2c6acb04-1e94-4c14-be52-8098236ca449', '18f11576-6103-4b63-bf85-4da40906aa7e', 'a01bc95f-db05-48e2-95c8-e7836afd94a7'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:35 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab 1073741824" returned: 0 in 1.094s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:35 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:35 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:35 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab Sep 28 16:00:35 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:36 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.736s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Deleted volume successfully. Sep 28 16:00:36 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab" returned: 0 in 0.741s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-171eab69-297a-44aa-a68c-00cc163e1f59 tempest-VolumesListAdminTestJSON-1389714852 None] Lock "cinder-c7f4b645-a4ab-4c5e-a6ab-970c1da4dc5a-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cc075a-b09d-432c-bcca-811bd034d562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f46082-b744-4322-ae8b-62e0002b2aab', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0406ccb4-60eb-49e1-8ac5-00cb2e065bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:36 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Volume volume-43f46082-b744-4322-ae8b-62e0002b2aab (43f46082-b744-4322-ae8b-62e0002b2aab): created successfully Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0406ccb4-60eb-49e1-8ac5-00cb2e065bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Flow 'volume_create_manager' (2700e5f9-c86f-4e7e-ad49-c4755f4a42d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-970e5c35-5189-472a-a0b8-0e7858ba79bf tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Created volume successfully. Sep 28 16:00:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:38 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:38 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:39 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.538s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:39 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c4a0dd54-1caa-4d2a-a199-2f495297cdb5 tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Retype volume completed successfully. Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Acquiring lock "cinder-43f46082-b744-4322-ae8b-62e0002b2aab-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "cinder-43f46082-b744-4322-ae8b-62e0002b2aab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=127,cinder:UPDATE=154,cinder:DELETE=17,cinder:INSERT=48 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=141,cinder:INSERT=38,cinder:UPDATE=160,cinder:DELETE=10 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Acquiring lock "cinder-quobyte-43f46082-b744-4322-ae8b-62e0002b2aab" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "cinder-quobyte-43f46082-b744-4322-ae8b-62e0002b2aab" acquired by "delete_volume" :: waited 0.083s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:00:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-8281aa15-42c4-4a04-b74f-3b1efc93e057 tempest-ServerActionsTestOtherA-1827865301 None] Terminate volume connection completed successfully. Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-8281aa15-42c4-4a04-b74f-3b1efc93e057 tempest-ServerActionsTestOtherA-1827865301 None] Deleting attachment 0d254655-6d85-4280-83e9-16e8f1ed94a5. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b4594a-3ac1-410c-bbee-2aa3b2115fa4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:40 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab Sep 28 16:00:40 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:41 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab" returned: 0 in 0.657s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:41 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab Sep 28 16:00:41 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:41 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-43f46082-b744-4322-ae8b-62e0002b2aab" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "cinder-quobyte-43f46082-b744-4322-ae8b-62e0002b2aab" released by "delete_volume" :: held 1.188s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:41 devstack cinder-volume[86628]: WARNING cinder.quota [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:00:41 devstack cinder-volume[86628]: WARNING cinder.quota [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Created reservations ['6ac910f9-8622-4b5e-849b-9d7fd72ae063', '16f20fda-2e84-4093-85e2-d85c183fbc1a', '8a91bb2f-f7f1-4549-9284-3ce5505a1aa7', '192a7786-46b6-4468-9bd0-4fe5e106705d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:41 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:00:41 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:42 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.379s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:42 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Deleted volume successfully. Sep 28 16:00:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1d40b024-aff0-4e65-9cb4-59dbf04c336f tempest-VolumeRetypeWithoutMigrationTest-2092701622 None] Lock "cinder-43f46082-b744-4322-ae8b-62e0002b2aab-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:00:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-01c53a88-e02c-4242-bc9e-cc2cd2e17d7f tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-01c53a88-e02c-4242-bc9e-cc2cd2e17d7f tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-01c53a88-e02c-4242-bc9e-cc2cd2e17d7f tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-01c53a88-e02c-4242-bc9e-cc2cd2e17d7f tempest-ServerActionsTestOtherA-1827865301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45ee2ae4-647d-42e8-9a74-99333153e8d1', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:00:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-5e15b6d0-f970-437a-9eff-8bccc576412e req-01c53a88-e02c-4242-bc9e-cc2cd2e17d7f tempest-ServerActionsTestOtherA-1827865301 None] attachment_update completed successfully. Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Flow 'volume_create_manager' (34f1e324-becb-4cda-98b6-4dc1e913c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c1a2b2-09d7-4d1c-baeb-73ed3ee6036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c1a2b2-09d7-4d1c-baeb-73ed3ee6036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-762002644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2890963d-eb7c-4dd3-8c1d-e08efea40f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e818e8a446fe4c799ce3c339f1787369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:52Z,use_quota=True,user_id='633b072cc3bb473fbf39a15ff4d08d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2de077-fca2-4509-8a67-d1e3b7459580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2de077-fca2-4509-8a67-d1e3b7459580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3eb718-4b5d-4a61-a32d-d26e914285e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3eb718-4b5d-4a61-a32d-d26e914285e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2890963d-eb7c-4dd3-8c1d-e08efea40f75', 'volume_name': 'volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b932fe-32cc-4cf6-9b03-60d31967061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b932fe-32cc-4cf6-9b03-60d31967061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cddfbac7-9c50-4d2e-b701-021ed0a9c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:52 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Volume 2890963d-eb7c-4dd3-8c1d-e08efea40f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75', 'volume_size': 1} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-762002644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2890963d-eb7c-4dd3-8c1d-e08efea40f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e818e8a446fe4c799ce3c339f1787369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:00:52Z,use_quota=True,user_id='633b072cc3bb473fbf39a15ff4d08d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Creating volume 2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:00:52 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:00:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:52 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 1073741824 Sep 28 16:00:52 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:53 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 1073741824" returned: 0 in 0.879s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:53 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 Sep 28 16:00:53 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:54 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75" returned: 0 in 0.541s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cddfbac7-9c50-4d2e-b701-021ed0a9c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504bff24-38a4-4cb6-9097-cb104d1a91ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:00:54 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Volume volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 (2890963d-eb7c-4dd3-8c1d-e08efea40f75): created successfully Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504bff24-38a4-4cb6-9097-cb104d1a91ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:00:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Flow 'volume_create_manager' (34f1e324-becb-4cda-98b6-4dc1e913c352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:00:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1e008a3e-00c0-4a71-ad46-cdf97d2edbfe tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Created volume successfully. Sep 28 16:00:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:00:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:00:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Creating offline snapshot 03b80655-e974-4630-92be-4e77ae0bc24d of volume 2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:00:55 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd209f8-620c-4cb2-b7d2-276539b1e042]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:00:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:55 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 Sep 28 16:00:55 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:56 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75" returned: 0 in 0.721s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:56 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d 1G Sep 28 16:00:56 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:57 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d 1G" returned: 0 in 0.739s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:57 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d Sep 28 16:00:57 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:57 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d" returned: 0 in 0.397s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:57 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d is being set with open permissions: ugo+rw Sep 28 16:00:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:57 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d Sep 28 16:00:57 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:58 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d" returned: 0 in 0.367s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:58 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info Sep 28 16:00:58 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:58 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info" returned: 0 in 0.430s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:58 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info is being set with open permissions: ugo+rw Sep 28 16:00:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:58 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info Sep 28 16:00:58 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:58 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.info" returned: 0 in 0.356s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:00:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-58ae3466-ed70-4f4f-ad1e-5032d33e0e84 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Create snapshot completed successfully Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Flow 'volume_create_manager' (f7845864-3381-429b-baf0-e97d39f11886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fa9c26-d837-4ef9-a955-40b28eff5cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fa9c26-d837-4ef9-a955-40b28eff5cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-411728758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd1232a-48bd-455e-929e-b4730b477d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12253378027648c68585f2e7e355a4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:01Z,use_quota=True,user_id='ebeed9097bb545abb89efcb9aeabb3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12f5e39-e4eb-4dc0-af94-276d4f3e3de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12f5e39-e4eb-4dc0-af94-276d4f3e3de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d0bc3-8c15-432e-9647-6811b17142d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51d0bc3-8c15-432e-9647-6811b17142d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd1232a-48bd-455e-929e-b4730b477d8c', 'volume_name': 'volume-3bd1232a-48bd-455e-929e-b4730b477d8c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c0d6b9-c5b3-4d4d-9b9f-3c76412fa4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c0d6b9-c5b3-4d4d-9b9f-3c76412fa4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cabb9f3-48bd-47a5-a99f-9b27a9b2f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Volume 3bd1232a-48bd-455e-929e-b4730b477d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd1232a-48bd-455e-929e-b4730b477d8c', 'volume_size': 1} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-411728758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd1232a-48bd-455e-929e-b4730b477d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12253378027648c68585f2e7e355a4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:01Z,use_quota=True,user_id='ebeed9097bb545abb89efcb9aeabb3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Creating volume 3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:00 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "cinder-03b80655-e974-4630-92be-4e77ae0bc24d-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-03b80655-e974-4630-92be-4e77ae0bc24d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:00 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c 1073741824 Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "cinder-quobyte-2890963d-eb7c-4dd3-8c1d-e08efea40f75" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:00 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-quobyte-2890963d-eb7c-4dd3-8c1d-e08efea40f75" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "cinder-quobyte-03b80655-e974-4630-92be-4e77ae0bc24d" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-quobyte-03b80655-e974-4630-92be-4e77ae0bc24d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Deleting offline snapshot 03b80655-e974-4630-92be-4e77ae0bc24d of volume 2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] snapshot_file for this snap is: volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4df04-4b47-4e11-9f92-59268e70ba81]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:01 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d Sep 28 16:01:01 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:01 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c 1073741824" returned: 0 in 0.656s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:01 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d" returned: 0 in 0.540s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[17089edc-9007-453b-b6e2-e3af1f27f18d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:01 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:01 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:01 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 Sep 28 16:01:01 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:01 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cabb9f3-48bd-47a5-a99f-9b27a9b2f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd1232a-48bd-455e-929e-b4730b477d8c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b267b6-29d3-43c5-a7d9-825e9199c850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Volume volume-3bd1232a-48bd-455e-929e-b4730b477d8c (3bd1232a-48bd-455e-929e-b4730b477d8c): created successfully Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b267b6-29d3-43c5-a7d9-825e9199c850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Flow 'volume_create_manager' (f7845864-3381-429b-baf0-e97d39f11886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0db8da4a-e92e-45d5-9882-e77a7aed804c tempest-VolumesDeleteCascade-1645298429 None] Created volume successfully. Sep 28 16:01:01 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75" returned: 0 in 0.523s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:02 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d Sep 28 16:01:02 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:02 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d" returned: 0 in 0.401s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:02 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d Sep 28 16:01:02 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:02 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75.03b80655-e974-4630-92be-4e77ae0bc24d" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-quobyte-03b80655-e974-4630-92be-4e77ae0bc24d" released by "_delete_snapshot" :: held 1.970s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-quobyte-2890963d-eb7c-4dd3-8c1d-e08efea40f75" released by "delete_snapshot" :: held 2.003s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:02 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Created reservations ['6a85712d-52d6-4ddb-969c-df261e248db3', 'b2487b0c-4f66-4f26-b084-2b5acd951b9e', 'bb1f9b05-4800-4674-8353-66b0ec01bcb9', '5b5b729c-b84f-4da7-924f-ce9aaba7eaea'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:03 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Delete snapshot completed successfully. Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Creating offline snapshot 34c6491b-6cd5-462a-8afa-1cc2c1152da2 of volume 3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6908c9c2-6dc7-4bfc-9304-1451b59fc3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-03b80655-e974-4630-92be-4e77ae0bc24d-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[72396f5f-ff79-4ae4-a6d3-1fa88bd16158]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:03 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:03 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:03 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.516s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:03 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 1G Sep 28 16:01:03 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "cinder-2890963d-eb7c-4dd3-8c1d-e08efea40f75-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-2890963d-eb7c-4dd3-8c1d-e08efea40f75-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "cinder-quobyte-2890963d-eb7c-4dd3-8c1d-e08efea40f75" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-quobyte-2890963d-eb7c-4dd3-8c1d-e08efea40f75" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:04 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 1G" returned: 0 in 0.725s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb708cd-59f8-4d36-b61a-1b68168e00d5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:04 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:04 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:04 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 Sep 28 16:01:04 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:04 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.403s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:04 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 is being set with open permissions: ugo+rw Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:04 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:04 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:04 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75" returned: 0 in 0.566s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:05 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75 Sep 28 16:01:05 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:05 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.472s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:05 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info Sep 28 16:01:05 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:05 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2890963d-eb7c-4dd3-8c1d-e08efea40f75" returned: 0 in 0.557s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-quobyte-2890963d-eb7c-4dd3-8c1d-e08efea40f75" released by "delete_volume" :: held 1.268s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Created reservations ['bb3d1864-a1dd-41b6-80a5-efed00d05dd2', 'ac669040-741a-40b9-acc5-68a4c6dde304', 'e3060e34-9e60-4f24-b09c-864767804a22', 'e452c7db-fa61-4ef6-b924-705a5bec0747'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:05 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info" returned: 0 in 0.518s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:05 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info is being set with open permissions: ugo+rw Sep 28 16:01:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:05 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:05 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:05 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info Sep 28 16:01:05 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:06 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.info" returned: 0 in 0.362s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:06 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.431s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:06 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Deleted volume successfully. Sep 28 16:01:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4fbb9da5-8f9d-4896-831d-62d56f13171f tempest-VolumesDeleteCascade-1645298429 None] Create snapshot completed successfully Sep 28 16:01:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9dde3bdb-849c-4cd9-94fa-9a837faa45a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1079672557 None] Lock "cinder-2890963d-eb7c-4dd3-8c1d-e08efea40f75-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Creating offline snapshot c3f1e84a-a731-4f06-beca-ee4616632727 of volume 3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:01:07 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc46394-1438-4ce7-8f2a-cec9e204b4d3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:07 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:07 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:08 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.538s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd1232a-48bd-455e-929e-b4730b477d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:08 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 1G Sep 28 16:01:08 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:09 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 1G" returned: 0 in 0.734s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:09 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 Sep 28 16:01:09 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:09 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:09 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 is being set with open permissions: ugo+rw Sep 28 16:01:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:09 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 Sep 28 16:01:09 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:09 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727" returned: 0 in 0.357s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c27d699d-cf05-46a0-a693-7e67ac3f1660 tempest-VolumesDeleteCascade-1645298429 None] Create snapshot completed successfully Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-3bd1232a-48bd-455e-929e-b4730b477d8c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-3bd1232a-48bd-455e-929e-b4730b477d8c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Performing cascade delete. {{(pid=86628) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-34c6491b-6cd5-462a-8afa-1cc2c1152da2-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-34c6491b-6cd5-462a-8afa-1cc2c1152da2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-34c6491b-6cd5-462a-8afa-1cc2c1152da2" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-34c6491b-6cd5-462a-8afa-1cc2c1152da2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Deleting offline snapshot 34c6491b-6cd5-462a-8afa-1cc2c1152da2 of volume 3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] snapshot_file for this snap is: volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1a2ab-717c-4a5c-88c7-1d7fb50880a6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:11 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:11 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:12 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.749s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd1232a-48bd-455e-929e-b4730b477d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaa6014-7a92-4b11-aca4-4a3d411d411f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:12 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:12 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:12 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.459s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[772bff59-c8ff-4fe5-be70-73e65a6f41e7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:12 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 Sep 28 16:01:12 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:13 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727" returned: 0 in 0.478s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd1232a-48bd-455e-929e-b4730b477d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961fdb1-733a-4ab7-b254-ec5db6dec5e9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:13 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:13 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:13 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.458s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd1232a-48bd-455e-929e-b4730b477d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb398cd-100f-450f-beb0-90f6ac542918]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:13 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:13 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:14 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.490s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:14 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:14 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:14 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.445s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:14 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2 Sep 28 16:01:14 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:15 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.34c6491b-6cd5-462a-8afa-1cc2c1152da2" returned: 0 in 0.452s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 -F qcow2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:15 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 -F qcow2 Sep 28 16:01:15 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:15 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd1232a-48bd-455e-929e-b4730b477d8c /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 -F qcow2" returned: 0 in 0.469s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-34c6491b-6cd5-462a-8afa-1cc2c1152da2" released by "_delete_snapshot" :: held 4.296s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" released by "delete_snapshot" :: held 4.323s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Created reservations ['d4f50981-3cae-4895-b371-038ceb9ee02b', '83629a86-60ea-42ee-88f3-4ee9034d5f22', '7dc960a7-7c03-477e-8b3c-be766befde9f', '7851951e-18ae-4566-928a-a46213666707'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Delete snapshot completed successfully. Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-34c6491b-6cd5-462a-8afa-1cc2c1152da2-delete_snapshot" released by "delete_snapshot" :: held 4.554s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-c3f1e84a-a731-4f06-beca-ee4616632727-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-c3f1e84a-a731-4f06-beca-ee4616632727-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-c3f1e84a-a731-4f06-beca-ee4616632727" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-c3f1e84a-a731-4f06-beca-ee4616632727" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Deleting offline snapshot c3f1e84a-a731-4f06-beca-ee4616632727 of volume 3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] snapshot_file for this snap is: volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[927b4308-2f65-4940-bcf6-af35bc1c4439]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:16 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 Sep 28 16:01:16 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:16 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727" returned: 0 in 0.543s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd1232a-48bd-455e-929e-b4730b477d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5255cb-3ca9-4c40-84e2-dc65ba284b56]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:16 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:16 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:17 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.780s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:17 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 Sep 28 16:01:17 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:17 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:17 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727 Sep 28 16:01:17 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:18 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c.c3f1e84a-a731-4f06-beca-ee4616632727" returned: 0 in 0.366s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-c3f1e84a-a731-4f06-beca-ee4616632727" released by "_delete_snapshot" :: held 2.470s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" released by "delete_snapshot" :: held 2.510s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Created reservations ['1aca40a4-7ab0-4e09-8622-cec58e242fc5', 'ccced611-d6cc-4eea-8f2c-66354013376d', '70b57759-9921-43f8-921a-441338a0fe7a', '9f8b3e71-c5b0-4c4d-bdc2-cdf668ddcc59'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Delete snapshot completed successfully. Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-c3f1e84a-a731-4f06-beca-ee4616632727-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Snapshots deleted, issuing volume delete {{(pid=86628) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd59ee6b-0e67-4c54-9596-179f09a9ebd2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:18 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:18 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:19 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.689s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:19 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c Sep 28 16:01:19 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:19 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3bd1232a-48bd-455e-929e-b4730b477d8c" returned: 0 in 0.510s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-3bd1232a-48bd-455e-929e-b4730b477d8c" released by "delete_volume" :: held 1.343s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Created reservations ['8897dc15-cf9a-44ad-b0f4-0540aa805e8d', '65925c80-cc81-4e84-9454-ad933e71ee77', '43247490-8166-42dd-8f6d-73c598ba340d', '3cbb8b5b-f2bc-48a2-93b7-f83ab65cdff6'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:20 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:20 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:20 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Deleted volume successfully. Sep 28 16:01:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0fc68c10-f9d7-4d58-af06-5da2b62a2ee6 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-3bd1232a-48bd-455e-929e-b4730b477d8c-delete_volume" released by "delete_volume" :: held 9.628s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:22 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Flow 'volume_create_manager' (57e3b6ac-d5c1-4d02-a190-b09fb422fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fd42bc-bf74-4e4f-9c9b-e26c16d9756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fd42bc-bf74-4e4f-9c9b-e26c16d9756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565225923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ee8f00-321d-4fda-b723-252fbd7def6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12253378027648c68585f2e7e355a4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:23Z,use_quota=True,user_id='ebeed9097bb545abb89efcb9aeabb3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d425c719-0bbf-4abd-b876-5f97221e1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d425c719-0bbf-4abd-b876-5f97221e1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6699c82b-355e-459b-bd15-fd4c855221e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6699c82b-355e-459b-bd15-fd4c855221e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ee8f00-321d-4fda-b723-252fbd7def6b', 'volume_name': 'volume-f5ee8f00-321d-4fda-b723-252fbd7def6b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa7d0e5-3346-454d-bae7-896be4dab521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa7d0e5-3346-454d-bae7-896be4dab521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d57f52-d8ba-468c-bc4e-63b537532163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:23 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Volume f5ee8f00-321d-4fda-b723-252fbd7def6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ee8f00-321d-4fda-b723-252fbd7def6b', 'volume_size': 1} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565225923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ee8f00-321d-4fda-b723-252fbd7def6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12253378027648c68585f2e7e355a4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:23Z,use_quota=True,user_id='ebeed9097bb545abb89efcb9aeabb3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Creating volume f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:23 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:23 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b 1073741824 Sep 28 16:01:23 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:23 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b 1073741824" returned: 0 in 0.731s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:24 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b Sep 28 16:01:24 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-bb607b8a-d317-4e4b-8c52-b7d4e1e62fcc tempest-ServerActionsTestOtherA-1827865301 None] Terminate volume connection completed successfully. Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-bb607b8a-d317-4e4b-8c52-b7d4e1e62fcc tempest-ServerActionsTestOtherA-1827865301 None] Deleting attachment 45ee2ae4-647d-42e8-9a74-99333153e8d1. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:01:24 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b" returned: 0 in 0.618s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d57f52-d8ba-468c-bc4e-63b537532163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ee8f00-321d-4fda-b723-252fbd7def6b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7359589-82b1-4a7b-8a83-78bd2781b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:24 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Volume volume-f5ee8f00-321d-4fda-b723-252fbd7def6b (f5ee8f00-321d-4fda-b723-252fbd7def6b): created successfully Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7359589-82b1-4a7b-8a83-78bd2781b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Flow 'volume_create_manager' (57e3b6ac-d5c1-4d02-a190-b09fb422fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-05340524-1cc9-44ad-821c-84d0b90aff8c tempest-VolumesDeleteCascade-1645298429 None] Created volume successfully. Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "cinder-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "cinder-quobyte-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-quobyte-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" acquired by "delete_volume" :: waited 0.054s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[30235f69-df20-4d20-84e1-d7b0204e93af]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:25 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 Sep 28 16:01:25 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:25 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" returned: 0 in 0.751s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:25 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4 Sep 28 16:01:25 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Creating offline snapshot d66bf758-4324-43a9-b380-c297c0f3fd1b of volume f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d29838f-52b0-4483-9b31-fc2438be1664]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:26 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b Sep 28 16:01:26 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:26 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" returned: 0 in 0.394s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-quobyte-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4" released by "delete_volume" :: held 1.264s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.quota [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Created reservations ['96512ea2-d760-4bbc-8c8b-f055d28df4ce', 'a90222dc-bf8a-42f8-b9db-1187ce035527', '1fe22971-9bb2-4474-a90d-e1f255b85c7a', '7eb8bc41-08ba-4c81-9c30-7879a798f424'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:26 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:26 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:26 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b" returned: 0 in 0.682s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:26 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b 1G Sep 28 16:01:26 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:26 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:26 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:26 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.476s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:26 devstack cinder-volume[86628]: DEBUG cinder.manager [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:27 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Deleted volume successfully. Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-b6b477ab-7b5d-418c-b259-fd64b7d0eeee req-c40ba5de-4cf6-42f9-9afe-8ac860a7eca9 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-27897c8e-a4a0-4862-b0dc-6dbf52aecfb4-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "cinder-3c845cd6-40d7-4d2e-a544-371a03785d2e-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-3c845cd6-40d7-4d2e-a544-371a03785d2e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:27 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.522s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "cinder-quobyte-3c845cd6-40d7-4d2e-a544-371a03785d2e" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-quobyte-3c845cd6-40d7-4d2e-a544-371a03785d2e" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3cd0f4-1c66-421b-bcac-4a3695c165c5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:27 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b 1G" returned: 0 in 0.890s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ee8f00-321d-4fda-b723-252fbd7def6b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:27 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ee8f00-321d-4fda-b723-252fbd7def6b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b Sep 28 16:01:27 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:27 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e Sep 28 16:01:27 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:27 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5ee8f00-321d-4fda-b723-252fbd7def6b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:27 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b is being set with open permissions: ugo+rw Sep 28 16:01:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:27 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b Sep 28 16:01:27 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:28 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e" returned: 0 in 0.604s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:28 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e Sep 28 16:01:28 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:28 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b" returned: 0 in 0.435s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:28 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info Sep 28 16:01:28 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:28 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-3c845cd6-40d7-4d2e-a544-371a03785d2e" returned: 0 in 0.425s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-quobyte-3c845cd6-40d7-4d2e-a544-371a03785d2e" released by "delete_volume" :: held 1.101s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Created reservations ['1f090a47-a406-4142-9631-927134d208ec', '90e49496-446c-412e-8ae0-ad464d2ddae0', '05bd8fa7-1db9-4cbe-b40f-2c60640f24b3', '2c79fb91-54ab-4c30-9a3b-5cb751dcade5'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:28 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:28 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:28 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:28 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info is being set with open permissions: ugo+rw Sep 28 16:01:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:28 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info Sep 28 16:01:28 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:29 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.338s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:29 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Deleted volume successfully. Sep 28 16:01:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b927e1f6-cd78-4b56-bc57-e2fca5c84be3 tempest-ServerActionsTestOtherA-1827865301 None] Lock "cinder-3c845cd6-40d7-4d2e-a544-371a03785d2e-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:29 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.info" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.390s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0fc83df9-d3bc-4d89-87bc-1db5a3472463 tempest-VolumesDeleteCascade-1645298429 None] Create snapshot completed successfully Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Flow 'volume_create_manager' (335c7519-9d47-46d8-9f56-d07ca8a96aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038a001b-44d1-4103-ae9b-14414f99ef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038a001b-44d1-4103-ae9b-14414f99ef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-118254599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161bd539-af2f-429e-aa88-d882ed873859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12253378027648c68585f2e7e355a4a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d66bf758-4324-43a9-b380-c297c0f3fd1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:31Z,use_quota=True,user_id='ebeed9097bb545abb89efcb9aeabb3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52905f65-37c3-41d0-ae18-112b95677639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52905f65-37c3-41d0-ae18-112b95677639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe97503-1f7a-4e2a-a04e-33f4c2c62d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe97503-1f7a-4e2a-a04e-33f4c2c62d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '161bd539-af2f-429e-aa88-d882ed873859', 'volume_name': 'volume-161bd539-af2f-429e-aa88-d882ed873859', 'volume_size': 1, 'snapshot_id': 'd66bf758-4324-43a9-b380-c297c0f3fd1b'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e83acb-375a-4259-abe1-ff24af49c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e83acb-375a-4259-abe1-ff24af49c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b132e54-38ca-4b11-99dd-eada20767a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:31 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Volume 161bd539-af2f-429e-aa88-d882ed873859: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-161bd539-af2f-429e-aa88-d882ed873859', 'volume_size': 1, 'snapshot_id': 'd66bf758-4324-43a9-b380-c297c0f3fd1b'} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-d66bf758-4324-43a9-b380-c297c0f3fd1b-161bd539-af2f-429e-aa88-d882ed873859" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-d66bf758-4324-43a9-b380-c297c0f3fd1b-161bd539-af2f-429e-aa88-d882ed873859" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Creating volume 161bd539-af2f-429e-aa88-d882ed873859 from snapshot d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-161bd539-af2f-429e-aa88-d882ed873859" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-161bd539-af2f-429e-aa88-d882ed873859" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] snapshot: d66bf758-4324-43a9-b380-c297c0f3fd1b, volume: 161bd539-af2f-429e-aa88-d882ed873859, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d6067-b9bb-4773-8ce6-790419e222bd]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:31 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b Sep 28 16:01:31 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:31 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b" returned: 0 in 0.421s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5ee8f00-321d-4fda-b723-252fbd7def6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6196f53-5407-49ec-9f70-a33b20d832ee]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:32 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b Sep 28 16:01:32 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:32 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b" returned: 0 in 0.443s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:01:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:01:32 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:01:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:32 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 Sep 28 16:01:32 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:41 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=72,cinder:INSERT=19,cinder:UPDATE=76,cinder:DELETE=10 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:01:41 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=68,cinder:INSERT=19,cinder:UPDATE=69,cinder:DELETE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:42 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Flow 'volume_create_manager' (535427e1-a3dd-489a-bd67-10214402e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5357e-d1b5-4832-92f2-2464072605fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859" returned: 0 in 10.184s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:01:42 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Converted 1024.00 MB image at 100.54 MB/s Sep 28 16:01:42 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 is being set with open permissions: ugo+rw Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5357e-d1b5-4832-92f2-2464072605fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-488937232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30a90a3-0c5f-484c-a781-f86474cbff02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6992eebc705f4f58b1106b3bf4c3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:42Z,use_quota=True,user_id='31487fc34f5a496f9f7b10af1d19d192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:42 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 Sep 28 16:01:42 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37f831a-56a1-40f8-b9bf-cc952cf7349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37f831a-56a1-40f8-b9bf-cc952cf7349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8eca75-e14e-4336-bf6c-6a989d3f1ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8eca75-e14e-4336-bf6c-6a989d3f1ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30a90a3-0c5f-484c-a781-f86474cbff02', 'volume_name': 'volume-a30a90a3-0c5f-484c-a781-f86474cbff02', 'volume_size': 2}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3532dc7-6747-4579-a0f3-4fd465a88a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3532dc7-6747-4579-a0f3-4fd465a88a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1053ab18-7643-4580-96dc-afc6d84736eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Volume a30a90a3-0c5f-484c-a781-f86474cbff02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30a90a3-0c5f-484c-a781-f86474cbff02', 'volume_size': 2} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:42 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859" returned: 0 in 0.297s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-161bd539-af2f-429e-aa88-d882ed873859" released by "_copy_volume_from_snapshot" :: held 11.468s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-d66bf758-4324-43a9-b380-c297c0f3fd1b-161bd539-af2f-429e-aa88-d882ed873859" released by "_create_volume_from_snapshot" :: held 11.578s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.595s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-488937232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30a90a3-0c5f-484c-a781-f86474cbff02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6992eebc705f4f58b1106b3bf4c3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:42Z,use_quota=True,user_id='31487fc34f5a496f9f7b10af1d19d192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Creating volume a30a90a3-0c5f-484c-a781-f86474cbff02 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:42 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:01:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 2147483648 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:43 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 2147483648 Sep 28 16:01:43 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b132e54-38ca-4b11-99dd-eada20767a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161bd539-af2f-429e-aa88-d882ed873859', 'volume_size': 1, 'snapshot_id': 'd66bf758-4324-43a9-b380-c297c0f3fd1b'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683ca225-8954-4f16-9b96-0566ca7da77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:43 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Volume volume-161bd539-af2f-429e-aa88-d882ed873859 (161bd539-af2f-429e-aa88-d882ed873859): created successfully Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683ca225-8954-4f16-9b96-0566ca7da77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Flow 'volume_create_manager' (335c7519-9d47-46d8-9f56-d07ca8a96aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-35709fb2-1a42-4043-b3ac-d38be4c46fd5 tempest-VolumesDeleteCascade-1645298429 None] Created volume successfully. Sep 28 16:01:43 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 2147483648" returned: 0 in 0.778s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-f5ee8f00-321d-4fda-b723-252fbd7def6b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:43 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 Sep 28 16:01:43 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-f5ee8f00-321d-4fda-b723-252fbd7def6b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Performing cascade delete. {{(pid=86628) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 16:01:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-d66bf758-4324-43a9-b380-c297c0f3fd1b-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-d66bf758-4324-43a9-b380-c297c0f3fd1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-f5ee8f00-321d-4fda-b723-252fbd7def6b" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-f5ee8f00-321d-4fda-b723-252fbd7def6b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-d66bf758-4324-43a9-b380-c297c0f3fd1b" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-d66bf758-4324-43a9-b380-c297c0f3fd1b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Deleting offline snapshot d66bf758-4324-43a9-b380-c297c0f3fd1b of volume f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] snapshot_file for this snap is: volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5285d412-6f3e-4ee8-a809-536d16c8f956]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:44 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02" returned: 0 in 0.466s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:44 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b Sep 28 16:01:44 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1053ab18-7643-4580-96dc-afc6d84736eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30a90a3-0c5f-484c-a781-f86474cbff02', 'volume_size': 2}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb083fdb-c3fc-48bc-bc01-b0d95483812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:44 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Volume volume-a30a90a3-0c5f-484c-a781-f86474cbff02 (a30a90a3-0c5f-484c-a781-f86474cbff02): created successfully Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb083fdb-c3fc-48bc-bc01-b0d95483812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Flow 'volume_create_manager' (535427e1-a3dd-489a-bd67-10214402e74d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b30a3438-5ef7-4d9b-9ce5-9a502d5b23ce tempest-VolumesCloneNegativeTest-1669413628 None] Created volume successfully. Sep 28 16:01:44 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b" returned: 0 in 0.497s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5ee8f00-321d-4fda-b723-252fbd7def6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf392030-f922-4cbe-98d2-967e403d46d6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Acquiring lock "cinder-a30a90a3-0c5f-484c-a781-f86474cbff02-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Lock "cinder-a30a90a3-0c5f-484c-a781-f86474cbff02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:44 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b Sep 28 16:01:44 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Acquiring lock "cinder-quobyte-a30a90a3-0c5f-484c-a781-f86474cbff02" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Lock "cinder-quobyte-a30a90a3-0c5f-484c-a781-f86474cbff02" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b081527c-a350-46cb-9574-0730721465d3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:45 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 Sep 28 16:01:45 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:45 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b" returned: 0 in 0.792s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:45 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:45 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b Sep 28 16:01:45 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02" returned: 0 in 0.557s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:45 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02 Sep 28 16:01:45 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:45 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a30a90a3-0c5f-484c-a781-f86474cbff02" returned: 0 in 0.328s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:45 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Lock "cinder-quobyte-a30a90a3-0c5f-484c-a781-f86474cbff02" released by "delete_volume" :: held 0.975s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Created reservations ['e61548c7-19b7-4d0a-af59-580bda88147d', 'af2d9778-d611-4118-8ae7-8b829a1e1d13', '39e317b5-d3fc-466e-b5a2-5093c62ae4a7', 'a9f972c9-239d-493d-b412-3c8bc831d5a8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:46 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b" returned: 0 in 0.671s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:46 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:46 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:46 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:46 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:46 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b.d66bf758-4324-43a9-b380-c297c0f3fd1b" returned: 0 in 0.371s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:46 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.376s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-d66bf758-4324-43a9-b380-c297c0f3fd1b" released by "_delete_snapshot" :: held 2.526s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:46 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Deleted volume successfully. Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-f5ee8f00-321d-4fda-b723-252fbd7def6b" released by "delete_snapshot" :: held 2.564s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bff5230d-7d65-40d3-b96c-f2d6540f62c7 tempest-VolumesCloneNegativeTest-1669413628 None] Lock "cinder-a30a90a3-0c5f-484c-a781-f86474cbff02-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Created reservations ['f3e1bf94-47dd-4fc7-9376-cfbab94ffb2b', '1a41cdac-5d44-41ed-9984-f61018aecfd8', '5dced72a-1a76-4879-a0b1-0b56f04c3907', '86c2c900-d454-4f78-9eb6-35dd90dd4519'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:46 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Delete snapshot completed successfully. Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-d66bf758-4324-43a9-b380-c297c0f3fd1b-delete_snapshot" released by "delete_snapshot" :: held 2.815s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Snapshots deleted, issuing volume delete {{(pid=86628) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-f5ee8f00-321d-4fda-b723-252fbd7def6b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-f5ee8f00-321d-4fda-b723-252fbd7def6b" acquired by "delete_volume" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d038c57-b05e-4a10-9180-471692c68a76]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:47 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b Sep 28 16:01:47 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:47 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b" returned: 0 in 0.512s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:47 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b Sep 28 16:01:47 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:47 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f5ee8f00-321d-4fda-b723-252fbd7def6b" returned: 0 in 0.422s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-f5ee8f00-321d-4fda-b723-252fbd7def6b" released by "delete_volume" :: held 1.048s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:47 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Created reservations ['32bd36b9-572e-457e-ae52-47712fed6d36', '08cb8b68-2ed3-4da6-9685-9578668b18aa', '3f0a78f5-9d93-4363-9682-41470d10e65a', '8a91891d-afa9-4b74-99ee-3092f901d4ff'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:48 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:48 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:48 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:48 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Deleted volume successfully. Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4474cc28-f193-4341-a462-fb84f7ba9d29 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-f5ee8f00-321d-4fda-b723-252fbd7def6b-delete_volume" released by "delete_volume" :: held 4.839s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-161bd539-af2f-429e-aa88-d882ed873859-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-161bd539-af2f-429e-aa88-d882ed873859-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "cinder-quobyte-161bd539-af2f-429e-aa88-d882ed873859" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:01:48 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-161bd539-af2f-429e-aa88-d882ed873859" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:01:49 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64b200-d9a8-4a9d-be64-706eff6e4006]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:01:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:49 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 Sep 28 16:01:49 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:49 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859" returned: 0 in 0.617s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:49 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859 Sep 28 16:01:49 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:50 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-161bd539-af2f-429e-aa88-d882ed873859" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-quobyte-161bd539-af2f-429e-aa88-d882ed873859" released by "delete_volume" :: held 1.073s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Created reservations ['b98bf15f-bf91-437b-8e4d-1a087d5c74d2', '7a10abcf-3768-4c3a-8cc5-27162d4c17a0', '708f6b91-1384-4f8c-a349-bb159e684669', 'bda9b5ac-a60a-4479-bc29-cc32ddc0d777'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:50 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:01:50 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:50 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.319s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Deleted volume successfully. Sep 28 16:01:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4699502-a1e0-4026-9811-26c9a338ac97 tempest-VolumesDeleteCascade-1645298429 None] Lock "cinder-161bd539-af2f-429e-aa88-d882ed873859-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:01:54 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (cb86ed37-c687-4557-9b47-05f35231dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76fd009-b167-4e8c-9901-8a0d98aa50de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76fd009-b167-4e8c-9901-8a0d98aa50de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-975032683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b5122b-5c63-4027-8a22-8639d9e1f07a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:55Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46dd6f97-04b7-4180-91bc-92f3e7c0f529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46dd6f97-04b7-4180-91bc-92f3e7c0f529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d7b8e1-9644-4720-a76b-d2f6233fc6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d7b8e1-9644-4720-a76b-d2f6233fc6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b5122b-5c63-4027-8a22-8639d9e1f07a', 'volume_name': 'volume-01b5122b-5c63-4027-8a22-8639d9e1f07a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372a21dc-edc8-4750-9490-9860cc6d6692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372a21dc-edc8-4750-9490-9860cc6d6692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a30c6f5-b39f-4ef2-bebd-d63ae2bbfa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:55 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Volume 01b5122b-5c63-4027-8a22-8639d9e1f07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b5122b-5c63-4027-8a22-8639d9e1f07a', 'volume_size': 1} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-975032683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b5122b-5c63-4027-8a22-8639d9e1f07a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:55Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Creating volume 01b5122b-5c63-4027-8a22-8639d9e1f07a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:55 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:55 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a 1073741824 Sep 28 16:01:55 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:55 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a 1073741824" returned: 0 in 0.632s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:55 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a Sep 28 16:01:55 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:56 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a30c6f5-b39f-4ef2-bebd-d63ae2bbfa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b5122b-5c63-4027-8a22-8639d9e1f07a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5855dc-9635-4e3a-8850-6ea56221eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Volume volume-01b5122b-5c63-4027-8a22-8639d9e1f07a (01b5122b-5c63-4027-8a22-8639d9e1f07a): created successfully Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5855dc-9635-4e3a-8850-6ea56221eb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (cb86ed37-c687-4557-9b47-05f35231dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1c0b3ab8-8d60-4487-a534-1532c3877c69 tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (10bd6fa3-7014-47ea-97ef-a140ec9b6423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01c4ea4-f60f-4a5d-bca7-a83f7ea004fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01c4ea4-f60f-4a5d-bca7-a83f7ea004fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1693421650',display_name='tempest-VolumesGetTest-Volume-1311514070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65b584b-c5d4-4f57-b34c-d360783b0ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:58Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fad470-b088-49f8-9a30-e50e47810aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fad470-b088-49f8-9a30-e50e47810aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bce194d-62ec-4f8a-9702-c3e32b7d3cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bce194d-62ec-4f8a-9702-c3e32b7d3cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65b584b-c5d4-4f57-b34c-d360783b0ee3', 'volume_name': 'volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e357afb-e0ef-4fe6-9f30-feb4bdd970f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e357afb-e0ef-4fe6-9f30-feb4bdd970f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca3614c-193a-4cff-a3ef-1ae2facc638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Volume d65b584b-c5d4-4f57-b34c-d360783b0ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3', 'volume_size': 1} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:01:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1693421650',display_name='tempest-VolumesGetTest-Volume-1311514070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65b584b-c5d4-4f57-b34c-d360783b0ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:01:58Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Creating volume d65b584b-c5d4-4f57-b34c-d360783b0ee3 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:01:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:01:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:58 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 1073741824 Sep 28 16:01:58 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:59 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 1073741824" returned: 0 in 0.575s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:59 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 Sep 28 16:01:59 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:59 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca3614c-193a-4cff-a3ef-1ae2facc638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57ebc7b-0156-46c6-b254-db8bc09bb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:01:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Volume volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 (d65b584b-c5d4-4f57-b34c-d360783b0ee3): created successfully Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57ebc7b-0156-46c6-b254-db8bc09bb883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:01:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (10bd6fa3-7014-47ea-97ef-a140ec9b6423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:01:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a6f38380-698d-47be-83e3-e60044c4614a tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:02:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-d65b584b-c5d4-4f57-b34c-d360783b0ee3-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Lock "cinder-d65b584b-c5d4-4f57-b34c-d360783b0ee3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-d65b584b-c5d4-4f57-b34c-d360783b0ee3" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-d65b584b-c5d4-4f57-b34c-d360783b0ee3" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f9361-1fee-4b37-b738-a7b4229d86c4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:01 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 Sep 28 16:02:01 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:01 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3" returned: 0 in 0.615s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:01 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3 Sep 28 16:02:01 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:01 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d65b584b-c5d4-4f57-b34c-d360783b0ee3" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-d65b584b-c5d4-4f57-b34c-d360783b0ee3" released by "delete_volume" :: held 1.029s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:01 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Created reservations ['adf800df-cc2f-437c-855a-6a05aa1ec791', '6ad32bea-fd7f-4a88-87dc-4061ead4fc36', '66ab79e9-f103-4580-9f9a-075c8c059417', '8d6de5e1-8d36-4cb4-881c-616b98cc1b5b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:02 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:02 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:02 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.287s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:02:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c7874481-3976-4857-98d6-f7d3b6a3e00a tempest-VolumesGetTest-1732958633 None] Lock "cinder-d65b584b-c5d4-4f57-b34c-d360783b0ee3-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-01b5122b-5c63-4027-8a22-8639d9e1f07a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Lock "cinder-01b5122b-5c63-4027-8a22-8639d9e1f07a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-01b5122b-5c63-4027-8a22-8639d9e1f07a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-01b5122b-5c63-4027-8a22-8639d9e1f07a" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925af5d-a682-47c4-b325-8a52b889602d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:03 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a Sep 28 16:02:03 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:03 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a" returned: 0 in 0.562s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:03 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a Sep 28 16:02:03 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:04 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01b5122b-5c63-4027-8a22-8639d9e1f07a" returned: 0 in 0.310s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-01b5122b-5c63-4027-8a22-8639d9e1f07a" released by "delete_volume" :: held 0.941s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Created reservations ['0f184d94-f1ec-48ce-b451-b73e6e8377f4', '1a2f225a-ae3b-4e72-ad2b-07fa3f435644', '7ff04985-9c5b-4a09-8aa9-3b829978d774', '852df100-731e-4ffe-b360-900e485b269d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:04 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:04 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:04 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.340s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:02:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-160c8e54-5b1a-4187-8480-37b7ef3038cd tempest-VolumesGetTest-1732958633 None] Lock "cinder-01b5122b-5c63-4027-8a22-8639d9e1f07a-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (24acb61b-7063-4624-9c43-518f638a9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53af8234-34a8-4560-88d1-046b98f03d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53af8234-34a8-4560-88d1-046b98f03d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185665568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fa58f2-c329-467a-b5b9-ca696356c315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:06Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a25a07-217c-4b3b-8e6c-ee006fa0c1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a25a07-217c-4b3b-8e6c-ee006fa0c1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28013245-0bbb-4dc2-afd3-c1ae82b35567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28013245-0bbb-4dc2-afd3-c1ae82b35567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77fa58f2-c329-467a-b5b9-ca696356c315', 'volume_name': 'volume-77fa58f2-c329-467a-b5b9-ca696356c315', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c2c25f-9994-4fa3-9880-0e4f2a0bc577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c2c25f-9994-4fa3-9880-0e4f2a0bc577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6920920-0f73-4a27-8b0d-55f33ad2f427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Volume 77fa58f2-c329-467a-b5b9-ca696356c315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77fa58f2-c329-467a-b5b9-ca696356c315', 'volume_size': 1} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185665568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fa58f2-c329-467a-b5b9-ca696356c315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:06Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Creating volume 77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:06 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:06 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 1073741824 Sep 28 16:02:06 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:06 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 1073741824" returned: 0 in 0.671s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:07 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 Sep 28 16:02:07 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:07 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315" returned: 0 in 0.438s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6920920-0f73-4a27-8b0d-55f33ad2f427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77fa58f2-c329-467a-b5b9-ca696356c315', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f49956c-abb2-4f68-b10c-38ad7d46c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Volume volume-77fa58f2-c329-467a-b5b9-ca696356c315 (77fa58f2-c329-467a-b5b9-ca696356c315): created successfully Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f49956c-abb2-4f68-b10c-38ad7d46c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (24acb61b-7063-4624-9c43-518f638a9c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-70842b82-f6ed-41e7-b649-2bd549ab2932 tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (ea30370e-af09-4d4b-b34d-a21a6290fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d923ac4c-42fa-4687-a9c8-6de24aceedb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d923ac4c-42fa-4687-a9c8-6de24aceedb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-508114563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61da1ab7-acee-42ec-bb5c-c906c013cae9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=77fa58f2-c329-467a-b5b9-ca696356c315,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:09Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdf6a16-f195-4710-a766-a2b72f5f692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdf6a16-f195-4710-a766-a2b72f5f692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970ca744-a2fd-4151-b4d5-b1f6dc31ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970ca744-a2fd-4151-b4d5-b1f6dc31ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '61da1ab7-acee-42ec-bb5c-c906c013cae9', 'volume_name': 'volume-61da1ab7-acee-42ec-bb5c-c906c013cae9', 'volume_size': 1, 'source_volid': '77fa58f2-c329-467a-b5b9-ca696356c315', 'source_volstatus': 'available'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e48a14-2ed7-4272-910c-165b3cffb9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e48a14-2ed7-4272-910c-165b3cffb9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8551148-bbd6-4c5b-9b6d-bf08aa1901ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:09 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Volume 61da1ab7-acee-42ec-bb5c-c906c013cae9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-61da1ab7-acee-42ec-bb5c-c906c013cae9', 'volume_size': 1, 'source_volid': '77fa58f2-c329-467a-b5b9-ca696356c315', 'source_volstatus': 'available'} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:09 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Cloning volume 77fa58f2-c329-467a-b5b9-ca696356c315 to volume 61da1ab7-acee-42ec-bb5c-c906c013cae9 Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Creating offline snapshot 1d9ff292-9031-4765-8762-fb049022ace1 of volume 77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[97499f54-5649-41d0-849f-d3b237bdc1d3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:09 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 Sep 28 16:02:09 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:10 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315" returned: 0 in 0.888s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:10 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 1G Sep 28 16:02:10 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:11 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 1G" returned: 0 in 1.100s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77fa58f2-c329-467a-b5b9-ca696356c315 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:11 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77fa58f2-c329-467a-b5b9-ca696356c315 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 Sep 28 16:02:11 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Flow 'volume_create_manager' (86b8dd83-ddb4-48a5-81ca-bf9ec12def6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5966f2ab-94a8-4310-b8ff-98a62f5442d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5966f2ab-94a8-4310-b8ff-98a62f5442d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1294654019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e655f07a-ffbe-4fe3-a297-f0506ab0b32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbe6eeea2544272a50b35d6eaa75c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:12Z,use_quota=True,user_id='a00a97c386d64d41b2670bfb956d7c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d533958c-877a-4e7c-bde2-0965e15199ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d533958c-877a-4e7c-bde2-0965e15199ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6085b1-8d1d-4cba-a0da-da0f839f0c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6085b1-8d1d-4cba-a0da-da0f839f0c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e655f07a-ffbe-4fe3-a297-f0506ab0b32d', 'volume_name': 'volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267cbcfd-192e-4d6f-a1f4-648c385324c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267cbcfd-192e-4d6f-a1f4-648c385324c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83542145-781a-4486-9ad4-0494b7a7b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Volume e655f07a-ffbe-4fe3-a297-f0506ab0b32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d', 'volume_size': 1} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:12 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77fa58f2-c329-467a-b5b9-ca696356c315 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1" returned: 0 in 0.642s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:12 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 is being set with open permissions: ugo+rw Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:12 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 Sep 28 16:02:12 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:12 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1" returned: 0 in 0.451s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:12 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info Sep 28 16:02:12 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:13 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:13 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info is being set with open permissions: ugo+rw Sep 28 16:02:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:13 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info Sep 28 16:02:13 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:13 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.info" returned: 0 in 0.439s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-61da1ab7-acee-42ec-bb5c-c906c013cae9" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-61da1ab7-acee-42ec-bb5c-c906c013cae9" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] snapshot: 1d9ff292-9031-4765-8762-fb049022ace1, volume: 61da1ab7-acee-42ec-bb5c-c906c013cae9, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df99dac-879f-4e49-a70c-9c669da6525f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:14 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 Sep 28 16:02:14 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:14 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1" returned: 0 in 0.649s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77fa58f2-c329-467a-b5b9-ca696356c315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39faa35-74a6-4d10-9550-7f473ecccdfe]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:15 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 Sep 28 16:02:15 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:15 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315" returned: 0 in 0.856s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:02:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:02:15 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:02:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:15 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 Sep 28 16:02:15 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (69cf5971-236c-4653-9daf-5249f82c6791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a8ef01-6286-4241-87c8-c75979a078bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a8ef01-6286-4241-87c8-c75979a078bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014990364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d70c937-4802-49b1-8686-425d35d31bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:17Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6222f5e-d4d5-401e-b232-cb74b0dbd40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6222f5e-d4d5-401e-b232-cb74b0dbd40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd1353d-5ce6-4bdc-80bc-59288973059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd1353d-5ce6-4bdc-80bc-59288973059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d70c937-4802-49b1-8686-425d35d31bea', 'volume_name': 'volume-2d70c937-4802-49b1-8686-425d35d31bea', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6f7dd-d675-4d87-9e7d-aab05e5b2a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6f7dd-d675-4d87-9e7d-aab05e5b2a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfa9c0a-7b2a-4e54-942f-2ace9e48fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Volume 2d70c937-4802-49b1-8686-425d35d31bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d70c937-4802-49b1-8686-425d35d31bea', 'volume_size': 1} Sep 28 16:02:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:25 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9" returned: 0 in 9.924s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:02:25 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Converted 1024.00 MB image at 103.17 MB/s Sep 28 16:02:25 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 is being set with open permissions: ugo+rw Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:25 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 Sep 28 16:02:25 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:25 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9" returned: 0 in 0.327s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-61da1ab7-acee-42ec-bb5c-c906c013cae9" released by "_copy_volume_from_snapshot" :: held 11.905s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-1d9ff292-9031-4765-8762-fb049022ace1" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-1d9ff292-9031-4765-8762-fb049022ace1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Deleting offline snapshot 1d9ff292-9031-4765-8762-fb049022ace1 of volume 77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] snapshot_file for this snap is: volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e84e4-ccd1-4381-ad18-c58f2af71120]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:26 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 Sep 28 16:02:26 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:26 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1" returned: 0 in 0.506s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77fa58f2-c329-467a-b5b9-ca696356c315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6919c99-2f39-4118-b5c7-a29913f17639]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:26 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 Sep 28 16:02:26 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:26 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=64,cinder:INSERT=18,cinder:SELECT=42,cinder:DELETE=6 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:02:26 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:26 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:27 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.450s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:27 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315" returned: 0 in 0.714s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:27 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 Sep 28 16:02:27 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:27 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1" returned: 0 in 0.426s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:27 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1 Sep 28 16:02:27 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:27 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315.1d9ff292-9031-4765-8762-fb049022ace1" returned: 0 in 0.311s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-1d9ff292-9031-4765-8762-fb049022ace1" released by "_delete_snapshot" :: held 2.111s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.479s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.859s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1294654019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e655f07a-ffbe-4fe3-a297-f0506ab0b32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbe6eeea2544272a50b35d6eaa75c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:12Z,use_quota=True,user_id='a00a97c386d64d41b2670bfb956d7c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Creating volume e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:28 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:28 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d 1073741824 Sep 28 16:02:28 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8551148-bbd6-4c5b-9b6d-bf08aa1901ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61da1ab7-acee-42ec-bb5c-c906c013cae9', 'volume_size': 1, 'source_volid': '77fa58f2-c329-467a-b5b9-ca696356c315', 'source_volstatus': 'available'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d35965a-0785-4076-8471-4333c4c90349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Volume volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 (61da1ab7-acee-42ec-bb5c-c906c013cae9): created successfully Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d35965a-0785-4076-8471-4333c4c90349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (ea30370e-af09-4d4b-b34d-a21a6290fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-12022535-3d97-4ce1-88bf-40514f6b2d57 tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:02:28 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d 1073741824" returned: 0 in 0.617s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:28 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:02:28 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:29 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.335s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.169s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014990364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d70c937-4802-49b1-8686-425d35d31bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:17Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Creating volume 2d70c937-4802-49b1-8686-425d35d31bea {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:29 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83542145-781a-4486-9ad4-0494b7a7b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e60868-8ff4-4d15-bb73-cec1cb940381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:29 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea 1073741824 Sep 28 16:02:29 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Volume volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d (e655f07a-ffbe-4fe3-a297-f0506ab0b32d): created successfully Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e60868-8ff4-4d15-bb73-cec1cb940381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Flow 'volume_create_manager' (86b8dd83-ddb4-48a5-81ca-bf9ec12def6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-07e2a6e8-86bc-4f58-9ee8-df8a4759356c tempest-VolumesActionsTest-445219964 None] Created volume successfully. Sep 28 16:02:29 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea 1073741824" returned: 0 in 0.781s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:30 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea Sep 28 16:02:30 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:30 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea" returned: 0 in 0.590s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfa9c0a-7b2a-4e54-942f-2ace9e48fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d70c937-4802-49b1-8686-425d35d31bea', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c20707-b88f-44ac-b084-37cfa121aa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Volume volume-2d70c937-4802-49b1-8686-425d35d31bea (2d70c937-4802-49b1-8686-425d35d31bea): created successfully Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c20707-b88f-44ac-b084-37cfa121aa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (69cf5971-236c-4653-9daf-5249f82c6791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (392182bd-21fa-4442-8a45-b845b900c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412dfdb2-18be-4553-8552-6b6b9e374f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-55de5716-0ca7-4e37-bef5-52b505d35195 tempest-VolumesActionsTest-212877458 None] Created volume successfully. Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412dfdb2-18be-4553-8552-6b6b9e374f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-59866293',display_name='tempest-VolumesGetTest-Volume-1984904143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70713d22-2995-431b-bcba-8947ce943157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:31Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c3c545-4eaf-4728-bd4c-3cc047f6cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c3c545-4eaf-4728-bd4c-3cc047f6cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70e4eed-4c8d-4fb0-8530-db3e57ad856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70e4eed-4c8d-4fb0-8530-db3e57ad856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70713d22-2995-431b-bcba-8947ce943157', 'volume_name': 'volume-70713d22-2995-431b-bcba-8947ce943157', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb713983-f410-472d-a629-82bc0fd7cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb713983-f410-472d-a629-82bc0fd7cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af3548-b2da-4237-a885-532703214491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Volume 70713d22-2995-431b-bcba-8947ce943157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70713d22-2995-431b-bcba-8947ce943157', 'volume_size': 1} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-59866293',display_name='tempest-VolumesGetTest-Volume-1984904143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70713d22-2995-431b-bcba-8947ce943157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:31Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Creating volume 70713d22-2995-431b-bcba-8947ce943157 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:30 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:31 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 1073741824 Sep 28 16:02:31 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d7769c00-6bf7-461f-b123-70dfcd6096d7 tempest-VolumesActionsTest-212877458 None] Acquiring lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea" by "attach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d7769c00-6bf7-461f-b123-70dfcd6096d7 tempest-VolumesActionsTest-212877458 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea" acquired by "attach_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d7769c00-6bf7-461f-b123-70dfcd6096d7 tempest-VolumesActionsTest-212877458 None] Attaching volume 2d70c937-4802-49b1-8686-425d35d31bea to instance f9c52757-b026-49fb-99f1-a7ac3d245356 at mountpoint /dev/vdb on host None. Sep 28 16:02:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d7769c00-6bf7-461f-b123-70dfcd6096d7 tempest-VolumesActionsTest-212877458 None] Attach volume completed successfully. Sep 28 16:02:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d7769c00-6bf7-461f-b123-70dfcd6096d7 tempest-VolumesActionsTest-212877458 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea" released by "attach_volume" :: held 0.203s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:31 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 1073741824" returned: 0 in 0.974s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:32 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 Sep 28 16:02:32 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:32 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157" returned: 0 in 0.452s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73af3548-b2da-4237-a885-532703214491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70713d22-2995-431b-bcba-8947ce943157', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7373eca5-9b91-4231-9b59-2b1ed6fe2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:32 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Volume volume-70713d22-2995-431b-bcba-8947ce943157 (70713d22-2995-431b-bcba-8947ce943157): created successfully Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7373eca5-9b91-4231-9b59-2b1ed6fe2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (392182bd-21fa-4442-8a45-b845b900c809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3451af19-7473-45b0-83d7-823b1d03d87e tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:02:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-08962ef3-dceb-4bce-af62-5dab79b55231 tempest-VolumesActionsTest-392469858 None] Terminate volume connection completed successfully. Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08962ef3-dceb-4bce-af62-5dab79b55231 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-detach_volume" by "detach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08962ef3-dceb-4bce-af62-5dab79b55231 tempest-VolumesActionsTest-392469858 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-70713d22-2995-431b-bcba-8947ce943157-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Lock "cinder-70713d22-2995-431b-bcba-8947ce943157-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-08962ef3-dceb-4bce-af62-5dab79b55231 tempest-VolumesActionsTest-392469858 None] Detaching volume 2d70c937-4802-49b1-8686-425d35d31bea from instance f9c52757-b026-49fb-99f1-a7ac3d245356. Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-70713d22-2995-431b-bcba-8947ce943157" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-70713d22-2995-431b-bcba-8947ce943157" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4758c4-722e-43d1-914d-648c2a13fb2e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-08962ef3-dceb-4bce-af62-5dab79b55231 tempest-VolumesActionsTest-392469858 None] Detach volume completed successfully. Sep 28 16:02:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08962ef3-dceb-4bce-af62-5dab79b55231 tempest-VolumesActionsTest-392469858 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-detach_volume" released by "detach_volume" :: held 0.401s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:33 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 Sep 28 16:02:33 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3744720e-d2e1-41ea-8b11-169f5cec62c2 tempest-VolumesActionsTest-212877458 None] Acquiring lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-detach_volume" by "detach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3744720e-d2e1-41ea-8b11-169f5cec62c2 tempest-VolumesActionsTest-212877458 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3744720e-d2e1-41ea-8b11-169f5cec62c2 tempest-VolumesActionsTest-212877458 None] Volume detach called, but volume not attached. Sep 28 16:02:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3744720e-d2e1-41ea-8b11-169f5cec62c2 tempest-VolumesActionsTest-212877458 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:34 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157" returned: 0 in 1.426s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:34 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157 Sep 28 16:02:34 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Acquiring lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Acquiring lock "cinder-quobyte-2d70c937-4802-49b1-8686-425d35d31bea" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Lock "cinder-quobyte-2d70c937-4802-49b1-8686-425d35d31bea" acquired by "delete_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a91b4d4-4a8e-4355-a410-54bd70b11a3e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:35 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-70713d22-2995-431b-bcba-8947ce943157" returned: 0 in 0.502s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-70713d22-2995-431b-bcba-8947ce943157" released by "delete_volume" :: held 2.029s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Created reservations ['b065e153-5164-4a2f-ad2a-a7cd4e4218cc', '21bc6746-41b8-46b0-ad1b-a1219e6ca02f', '73c42807-836a-4e5d-b1db-5505a07eb140', '49dd7851-2c82-4c37-b02e-0df00450094c'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:35 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea Sep 28 16:02:35 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:35 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:35 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:36 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea" returned: 0 in 1.063s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:36 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.616s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:36 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea Sep 28 16:02:36 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:36 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:02:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-68085afc-a1c0-47d6-9d9f-6961584be327 tempest-VolumesGetTest-1732958633 None] Lock "cinder-70713d22-2995-431b-bcba-8947ce943157-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-61da1ab7-acee-42ec-bb5c-c906c013cae9-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Lock "cinder-61da1ab7-acee-42ec-bb5c-c906c013cae9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-61da1ab7-acee-42ec-bb5c-c906c013cae9" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:37 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d70c937-4802-49b1-8686-425d35d31bea" returned: 0 in 1.059s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-61da1ab7-acee-42ec-bb5c-c906c013cae9" acquired by "delete_volume" :: waited 0.061s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Lock "cinder-quobyte-2d70c937-4802-49b1-8686-425d35d31bea" released by "delete_volume" :: held 2.320s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3590f7e9-1d23-489c-847c-7cb26811a307]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Created reservations ['ab2b0695-a69b-4222-a18b-e39907a57cd9', '7985204b-67c6-4854-92cb-d5bbadda66a0', 'f24735e6-77d4-4068-8aa0-7017845d5743', 'e0fee7cc-320a-4fb7-b20f-bc339561cedc'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:37 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 Sep 28 16:02:37 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:38 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:38 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:38 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9" returned: 0 in 0.916s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:38 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:38 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9 Sep 28 16:02:38 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.609s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:38 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Deleted volume successfully. Sep 28 16:02:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-10fb38f5-b47a-420b-89c4-795ce8694ffc tempest-VolumesActionsTest-212877458 None] Lock "cinder-2d70c937-4802-49b1-8686-425d35d31bea-delete_volume" released by "delete_volume" :: held 3.672s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:39 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-61da1ab7-acee-42ec-bb5c-c906c013cae9" returned: 0 in 0.594s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-61da1ab7-acee-42ec-bb5c-c906c013cae9" released by "delete_volume" :: held 1.637s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Created reservations ['877ca0c9-9fc5-43de-ba56-b764203288d0', '40ef11fb-7def-416f-806b-ab878a647bdc', 'a9b74d6c-ca23-41d9-934b-530c8b943ae0', '81a5a26c-bd2a-4585-b947-f2953e6aa141'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:39 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:39 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:40 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.601s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e7b64860-b337-47c4-ba02-d16fb34bac5f tempest-VolumesGetTest-1732958633 None] Lock "cinder-61da1ab7-acee-42ec-bb5c-c906c013cae9-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-77fa58f2-c329-467a-b5b9-ca696356c315-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Lock "cinder-77fa58f2-c329-467a-b5b9-ca696356c315-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-77fa58f2-c329-467a-b5b9-ca696356c315" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-77fa58f2-c329-467a-b5b9-ca696356c315" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a347b5f-a8f1-4ea9-ae5f-10c5e11caeaf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:40 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 Sep 28 16:02:40 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:41 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315" returned: 0 in 0.646s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:41 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315 Sep 28 16:02:41 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:41 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-77fa58f2-c329-467a-b5b9-ca696356c315" returned: 0 in 0.521s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-77fa58f2-c329-467a-b5b9-ca696356c315" released by "delete_volume" :: held 1.285s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:41 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=75,cinder:UPDATE=101,cinder:DELETE=8,cinder:INSERT=24 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:02:41 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Created reservations ['1ee1c981-fb94-462c-aca3-4e8e95840802', '7d929fb8-2007-4171-98ba-b566e3956a3f', 'afc2c2f3-640b-44b0-b7bc-09308b57bc81', '62d627ac-8e68-4fe1-8c91-62b9c1ff7172'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:42 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:42 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:42 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.459s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:02:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a5f7bac2-f475-4190-ab44-1ff915273353 tempest-VolumesGetTest-1732958633 None] Lock "cinder-77fa58f2-c329-467a-b5b9-ca696356c315-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (ded55724-5d0c-4705-8832-7889365c67a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43e5a67-9a68-4d46-9b04-979c23cb84de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43e5a67-9a68-4d46-9b04-979c23cb84de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-908400965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a306ad-148a-453a-b745-126c331a0920,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:45Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed856e3-8ae6-4419-ada3-feee281e240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed856e3-8ae6-4419-ada3-feee281e240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b4c39-0e50-4f2b-bf99-510e060d1806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:45 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (789c0751-983c-46da-88f3-99dc5d6be238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a498638-8dc9-4d17-acb9-4b85a540c169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a498638-8dc9-4d17-acb9-4b85a540c169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-777556191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ea7599-f44c-4852-8316-9425d3864e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:46Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06208d2d-9225-45f8-a825-46b33a8a1563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06208d2d-9225-45f8-a825-46b33a8a1563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aa0788-804c-41fc-929e-9bcd5c7070c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aa0788-804c-41fc-929e-9bcd5c7070c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ea7599-f44c-4852-8316-9425d3864e73', 'volume_name': 'volume-37ea7599-f44c-4852-8316-9425d3864e73', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf7bbe1-43dd-4cd0-a7ff-f82ac7a44dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf7bbe1-43dd-4cd0-a7ff-f82ac7a44dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d297cf72-2f4a-4593-a657-0a5fde438e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Volume 37ea7599-f44c-4852-8316-9425d3864e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ea7599-f44c-4852-8316-9425d3864e73', 'volume_size': 1} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-777556191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ea7599-f44c-4852-8316-9425d3864e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:46Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Creating volume 37ea7599-f44c-4852-8316-9425d3864e73 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:46 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b4c39-0e50-4f2b-bf99-510e060d1806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81a306ad-148a-453a-b745-126c331a0920', 'volume_name': 'volume-81a306ad-148a-453a-b745-126c331a0920', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:46 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 1073741824 Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a28b4f1-7dfd-4722-8123-3b4a8f25766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a28b4f1-7dfd-4722-8123-3b4a8f25766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadfa91c-5687-4198-831e-f80eea4471f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:46 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Volume 81a306ad-148a-453a-b745-126c331a0920: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81a306ad-148a-453a-b745-126c331a0920', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:02:46 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Trying to clone 81a306ad-148a-453a-b745-126c331a0920 from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:02:47 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 1073741824" returned: 0 in 0.736s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:47 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:02:47 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:02:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:47 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 Sep 28 16:02:47 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:47 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7cae5f-db2a-401c-8143-bc508ef81c3c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:48 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD Sep 28 16:02:48 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:48 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73" returned: 0 in 0.648s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d297cf72-2f4a-4593-a657-0a5fde438e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ea7599-f44c-4852-8316-9425d3864e73', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d7560-e735-4688-91f4-fcad3cf8a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:48 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Volume volume-37ea7599-f44c-4852-8316-9425d3864e73 (37ea7599-f44c-4852-8316-9425d3864e73): created successfully Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d7560-e735-4688-91f4-fcad3cf8a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (789c0751-983c-46da-88f3-99dc5d6be238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:48 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ed6bc71a-61d3-4201-99d1-a440366b48a0 tempest-VolumesActionsTest-212877458 None] Created volume successfully. Sep 28 16:02:48 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 is fetched for user 6436bb0384374d3da2f21c3ef11cd68d. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[473741f0-c426-4d6e-bf0e-eb62acd885ed]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:48 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD Sep 28 16:02:48 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:49 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-908400965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a306ad-148a-453a-b745-126c331a0920,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:45Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Creating volume 81a306ad-148a-453a-b745-126c331a0920 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:49 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:49 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 1073741824 Sep 28 16:02:49 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a7c1070a-5482-4a6a-97db-a5893bea01fc tempest-VolumesActionsTest-445219964 None] Acquiring lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" by "attach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a7c1070a-5482-4a6a-97db-a5893bea01fc tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" acquired by "attach_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a7c1070a-5482-4a6a-97db-a5893bea01fc tempest-VolumesActionsTest-445219964 None] Attaching volume e655f07a-ffbe-4fe3-a297-f0506ab0b32d to instance 2493a99e-3ec0-4744-9dc1-999c2fdd4ac4 at mountpoint /dev/vdb on host None. Sep 28 16:02:49 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 1073741824" returned: 0 in 0.691s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a7c1070a-5482-4a6a-97db-a5893bea01fc tempest-VolumesActionsTest-445219964 None] Attach volume completed successfully. Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a7c1070a-5482-4a6a-97db-a5893bea01fc tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" released by "attach_volume" :: held 0.179s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:50 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 Sep 28 16:02:50 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-37ea7599-f44c-4852-8316-9425d3864e73-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Lock "cinder-37ea7599-f44c-4852-8316-9425d3864e73-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-quobyte-37ea7599-f44c-4852-8316-9425d3864e73" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-37ea7599-f44c-4852-8316-9425d3864e73" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2573c7e7-356b-4ca1-b5a1-4f710b58eb53 tempest-VolumesActionsTest-445219964 None] Acquiring lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-detach_volume" by "detach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2573c7e7-356b-4ca1-b5a1-4f710b58eb53 tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2573c7e7-356b-4ca1-b5a1-4f710b58eb53 tempest-VolumesActionsTest-445219964 None] Detaching volume e655f07a-ffbe-4fe3-a297-f0506ab0b32d from instance 2493a99e-3ec0-4744-9dc1-999c2fdd4ac4. Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d50b58b-290d-4687-9ed3-b890ed61af18]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2573c7e7-356b-4ca1-b5a1-4f710b58eb53 tempest-VolumesActionsTest-445219964 None] Detach volume completed successfully. Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2573c7e7-356b-4ca1-b5a1-4f710b58eb53 tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:50 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 Sep 28 16:02:50 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:50 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920" returned: 0 in 0.541s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Attempting download of dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume 81a306ad-148a-453a-b745-126c331a0920. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429b992-b062-4a12-a982-ec776261621c]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:50 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi Sep 28 16:02:50 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:50 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73" returned: 0 in 0.536s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:50 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73 Sep 28 16:02:50 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:51 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi" returned: 0 in 0.486s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:51 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-37ea7599-f44c-4852-8316-9425d3864e73" returned: 0 in 0.381s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:51 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi Sep 28 16:02:51 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-37ea7599-f44c-4852-8316-9425d3864e73" released by "delete_volume" :: held 1.005s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Created reservations ['deb8a44e-b69e-453a-9099-103ab9b012ce', '0eb345d9-5e5d-4ff6-a14f-a231d660c7c3', '08c701c2-6ec1-4660-87c9-ccbfc3fbfb05', 'f73965ed-fcb0-42de-91ec-01c81bd9b698'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:51 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi" returned: 1 in 0.432s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_zr24xgmi' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78d78c-324f-4e0c-9bfa-2e5728fd1e38]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:51 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:51 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:51 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD Sep 28 16:02:51 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:51 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.353s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Deleted volume successfully. Sep 28 16:02:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-07c4da65-9440-401f-92b8-fa2f03f69d1c tempest-VolumesActionsTest-392469858 None] Lock "cinder-37ea7599-f44c-4852-8316-9425d3864e73-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:52 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:52 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 was qcow2, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:02:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:52 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 Sep 28 16:02:52 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (a86c5c7c-423d-4678-a9d4-9062cd8cc13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5e533d-2817-49dd-a8a6-baa2278d05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5e533d-2817-49dd-a8a6-baa2278d05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1384540899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e521966b-35ac-4ff1-9a94-664a5b4555c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:53Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752be964-4e47-4065-9309-45e1df94ee06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752be964-4e47-4065-9309-45e1df94ee06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fadd015-8464-436a-b292-0811d7f1d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fadd015-8464-436a-b292-0811d7f1d89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e521966b-35ac-4ff1-9a94-664a5b4555c1', 'volume_name': 'volume-e521966b-35ac-4ff1-9a94-664a5b4555c1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944933c6-68c7-4665-934b-c6a8c8ca636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944933c6-68c7-4665-934b-c6a8c8ca636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b8a59f-a1cd-4767-925c-33311d350c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:53 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Volume e521966b-35ac-4ff1-9a94-664a5b4555c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e521966b-35ac-4ff1-9a94-664a5b4555c1', 'volume_size': 1} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1384540899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e521966b-35ac-4ff1-9a94-664a5b4555c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:53Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Creating volume e521966b-35ac-4ff1-9a94-664a5b4555c1 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:53 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:53 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 1073741824 Sep 28 16:02:53 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:54 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 1073741824" returned: 0 in 0.678s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:54 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 Sep 28 16:02:54 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:54 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1" returned: 0 in 0.289s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b8a59f-a1cd-4767-925c-33311d350c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e521966b-35ac-4ff1-9a94-664a5b4555c1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a86fef3-ba03-4403-97a2-594902471edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:54 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Volume volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 (e521966b-35ac-4ff1-9a94-664a5b4555c1): created successfully Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a86fef3-ba03-4403-97a2-594902471edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (a86c5c7c-423d-4678-a9d4-9062cd8cc13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6f67fb84-dcd4-461e-82fe-04ff8fcd724f tempest-VolumesActionsTest-212877458 None] Created volume successfully. Sep 28 16:02:54 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920" returned: 0 in 2.620s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_40n47wkidevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:02:54 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Converted 112.00 MB image at 42.73 MB/s Sep 28 16:02:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:54 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 1G Sep 28 16:02:54 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:55 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 1G" returned: 0 in 0.405s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Downloaded image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume 81a306ad-148a-453a-b745-126c331a0920 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 for user 6436bb0384374d3da2f21c3ef11cd68d is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Marking volume 81a306ad-148a-453a-b745-126c331a0920 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Copying metadata from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 to 81a306ad-148a-453a-b745-126c331a0920. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Creating volume glance metadata for volume 81a306ad-148a-453a-b745-126c331a0920 backed by image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadfa91c-5687-4198-831e-f80eea4471f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a306ad-148a-453a-b745-126c331a0920', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d01ce30-8ca3-4f35-88fc-3780d2c01d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:55 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Volume volume-81a306ad-148a-453a-b745-126c331a0920 (81a306ad-148a-453a-b745-126c331a0920): created successfully Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d01ce30-8ca3-4f35-88fc-3780d2c01d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (ded55724-5d0c-4705-8832-7889365c67a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f1cdd30c-65cb-490a-95eb-ae885386ffa9 tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-e521966b-35ac-4ff1-9a94-664a5b4555c1-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Lock "cinder-e521966b-35ac-4ff1-9a94-664a5b4555c1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-quobyte-e521966b-35ac-4ff1-9a94-664a5b4555c1" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-e521966b-35ac-4ff1-9a94-664a5b4555c1" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d51c8e3-f2a3-4473-aa9f-577bbaef6dc4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:56 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 Sep 28 16:02:56 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:56 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1" returned: 0 in 0.649s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:56 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1 Sep 28 16:02:56 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:57 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e521966b-35ac-4ff1-9a94-664a5b4555c1" returned: 0 in 0.647s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-e521966b-35ac-4ff1-9a94-664a5b4555c1" released by "delete_volume" :: held 1.416s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (0e5deceb-0a33-4de6-8ce9-164103f5086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccac2021-b9f7-4be2-8768-2ee825a56a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccac2021-b9f7-4be2-8768-2ee825a56a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-93164494',display_name='tempest-VolumesGetTest-Volume-452204831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a664b793-44b9-4fd4-99ab-59c256db8d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:57Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bded2d29-eca5-4143-92f6-f0a8811f4a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bded2d29-eca5-4143-92f6-f0a8811f4a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025e776e-ead0-4095-920b-27f7ae103bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025e776e-ead0-4095-920b-27f7ae103bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a664b793-44b9-4fd4-99ab-59c256db8d5b', 'volume_name': 'volume-a664b793-44b9-4fd4-99ab-59c256db8d5b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16bda4f-4f1b-4fa9-bff4-1a4e82ae7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16bda4f-4f1b-4fa9-bff4-1a4e82ae7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ed86ed-b0c7-440a-8486-e92755ab8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Volume a664b793-44b9-4fd4-99ab-59c256db8d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a664b793-44b9-4fd4-99ab-59c256db8d5b', 'volume_size': 1} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-93164494',display_name='tempest-VolumesGetTest-Volume-452204831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a664b793-44b9-4fd4-99ab-59c256db8d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4a9ec9310d4bf5a5b58d85c88d6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:57Z,use_quota=True,user_id='6436bb0384374d3da2f21c3ef11cd68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Creating volume a664b793-44b9-4fd4-99ab-59c256db8d5b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:57 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:57 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b 1073741824 Sep 28 16:02:57 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Created reservations ['e3dbbf27-5e6f-4148-abb8-6dcc5b7d8134', '4e506ebf-b2a6-483f-90b8-25e80de53af6', '22a710ed-9469-404a-827c-1ebd9524d1bb', 'dc9b0c85-ab7e-41a6-b182-ecd688566c1e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:57 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:02:57 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:57 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:02:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Deleted volume successfully. Sep 28 16:02:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12e5bc75-e4c7-4aee-a1db-55af4336fdf4 tempest-VolumesActionsTest-392469858 None] Lock "cinder-e521966b-35ac-4ff1-9a94-664a5b4555c1-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:02:58 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b 1073741824" returned: 0 in 0.667s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:58 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b Sep 28 16:02:58 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:58 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b" returned: 0 in 0.328s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ed86ed-b0c7-440a-8486-e92755ab8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a664b793-44b9-4fd4-99ab-59c256db8d5b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bab036-65f6-4a99-afde-314c21bfd0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Volume volume-a664b793-44b9-4fd4-99ab-59c256db8d5b (a664b793-44b9-4fd4-99ab-59c256db8d5b): created successfully Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bab036-65f6-4a99-afde-314c21bfd0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Flow 'volume_create_manager' (0e5deceb-0a33-4de6-8ce9-164103f5086c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-207cbff2-9c76-495d-923d-59b1708ea5dc tempest-VolumesGetTest-1732958633 None] Created volume successfully. Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (556b27c0-656e-4aa0-819e-70c9903e731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a62ff75-5177-4fd2-a9b7-7a7796f5897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a62ff75-5177-4fd2-a9b7-7a7796f5897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-871019759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a75bbb9-1966-4ba9-b71f-49d1cd48bd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:59Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aceba4-7328-4eb9-90ba-d0e36c3ab6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aceba4-7328-4eb9-90ba-d0e36c3ab6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80368b85-8b3d-4189-b753-616ebbe74b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80368b85-8b3d-4189-b753-616ebbe74b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a75bbb9-1966-4ba9-b71f-49d1cd48bd31', 'volume_name': 'volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c2e223-81d6-4035-9d2e-d874b1dfb7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c2e223-81d6-4035-9d2e-d874b1dfb7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0cd023-df42-4f49-a6ef-aeb67115e135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:02:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Volume 9a75bbb9-1966-4ba9-b71f-49d1cd48bd31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31', 'volume_size': 1} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-871019759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a75bbb9-1966-4ba9-b71f-49d1cd48bd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:02:59Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Creating volume 9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:02:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:02:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:58 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 1073741824 Sep 28 16:02:58 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-a664b793-44b9-4fd4-99ab-59c256db8d5b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Lock "cinder-a664b793-44b9-4fd4-99ab-59c256db8d5b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-a664b793-44b9-4fd4-99ab-59c256db8d5b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-a664b793-44b9-4fd4-99ab-59c256db8d5b" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[251cd340-5f9a-491c-a654-5116b1f193bf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:59 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 1073741824" returned: 0 in 0.679s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:02:59 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b Sep 28 16:02:59 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:02:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:02:59 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 Sep 28 16:02:59 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:00 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b" returned: 0 in 0.482s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:00 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31" returned: 0 in 0.377s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:00 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b Sep 28 16:03:00 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0cd023-df42-4f49-a6ef-aeb67115e135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ce9b62-ab32-4d51-aad8-cc0ddf1eda5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Volume volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 (9a75bbb9-1966-4ba9-b71f-49d1cd48bd31): created successfully Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ce9b62-ab32-4d51-aad8-cc0ddf1eda5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (556b27c0-656e-4aa0-819e-70c9903e731a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:00 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-01ca611f-4f7b-4c64-a165-f6f7c69cb4b8 tempest-VolumesActionsTest-212877458 None] Created volume successfully. Sep 28 16:03:00 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a664b793-44b9-4fd4-99ab-59c256db8d5b" returned: 0 in 0.509s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-a664b793-44b9-4fd4-99ab-59c256db8d5b" released by "delete_volume" :: held 1.058s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Created reservations ['2e9e691e-77d3-43e8-9731-e53a37d5866b', 'c24af32e-f70a-4ae0-ba1f-805190d08041', '0b7c2ea4-cac7-4f75-8285-9ac91ccf570e', '6cca834d-37bf-4a50-9877-828fed7d308f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:00 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:03:00 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Lock "cinder-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:01 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.793s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-quobyte-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-872ad815-b42a-4690-87a2-28f9708c1c3c tempest-VolumesGetTest-1732958633 None] Lock "cinder-a664b793-44b9-4fd4-99ab-59c256db8d5b-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[12497f30-89bb-408e-b7f2-bf539e2834cb]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-81a306ad-148a-453a-b745-126c331a0920-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Lock "cinder-81a306ad-148a-453a-b745-126c331a0920-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:01 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 Sep 28 16:03:01 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Acquiring lock "cinder-quobyte-81a306ad-148a-453a-b745-126c331a0920" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-81a306ad-148a-453a-b745-126c331a0920" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[628027d5-9575-4ad9-baaa-bc20c8c08e10]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:02 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 Sep 28 16:03:02 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:02 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31" returned: 0 in 0.732s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:02 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31 Sep 28 16:03:02 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:02 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920" returned: 0 in 0.603s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:02 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920 Sep 28 16:03:02 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:02 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31" returned: 0 in 0.467s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31" released by "delete_volume" :: held 1.284s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Flow 'volume_create_manager' (1e84f17d-b5f7-4d17-8aaa-50b107d14893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b74279-2c64-493a-8eb8-72cca6632422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:03 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-81a306ad-148a-453a-b745-126c331a0920" returned: 0 in 0.449s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b74279-2c64-493a-8eb8-72cca6632422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-417874668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf1b76d-a2fe-44f2-87e5-b271ad9aefc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d39451304f43c29f1bfa78db3c622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:03Z,use_quota=True,user_id='19e3d73dec28488991b978fde4ba1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a21f42e-93b4-4b4a-b26e-055e649a1003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a21f42e-93b4-4b4a-b26e-055e649a1003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d060b5c-4dff-4fa2-880f-b0562fe70077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d060b5c-4dff-4fa2-880f-b0562fe70077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf1b76d-a2fe-44f2-87e5-b271ad9aefc5', 'volume_name': 'volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fd8a37-a4b5-4e11-b8e9-bc44f57fd3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fd8a37-a4b5-4e11-b8e9-bc44f57fd3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9c4b5-5b0a-4a26-9337-cefe794e72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Volume edf1b76d-a2fe-44f2-87e5-b271ad9aefc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5', 'volume_size': 1} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-417874668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf1b76d-a2fe-44f2-87e5-b271ad9aefc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d39451304f43c29f1bfa78db3c622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:03Z,use_quota=True,user_id='19e3d73dec28488991b978fde4ba1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Creating volume edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:03 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Lock "cinder-quobyte-81a306ad-148a-453a-b745-126c331a0920" released by "delete_volume" :: held 1.254s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Created reservations ['0abdacb2-a720-4d5f-b6e2-c7857bd20a2f', '354bce0d-5337-438f-ab4d-a8fe9679e7b3', '64ddb223-f8d8-4cba-b7af-9f6693b465dc', '4f386d2c-26ad-433f-9d63-5a92eab6b761'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:03 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 1073741824 Sep 28 16:03:03 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Created reservations ['47ea5437-cb9d-47ce-a674-921a0527548b', 'adbe4cbe-e041-455c-88e8-52c1687ad5c7', '231d70bd-f60d-4aa0-9e99-cb23e4bbcb06', '534ec3e6-2908-4fb3-afd9-7dfb9a784b5d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:03 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:03:03 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:03 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:03:03 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:04 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.543s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Deleted volume successfully. Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e1434087-271a-4fbb-a923-faaff6044969 tempest-VolumesActionsTest-392469858 None] Lock "cinder-9a75bbb9-1966-4ba9-b71f-49d1cd48bd31-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:04 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.518s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Deleted volume successfully. Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-776bab2a-b98b-4d4b-b634-f649c986ae5b tempest-VolumesGetTest-1732958633 None] Lock "cinder-81a306ad-148a-453a-b745-126c331a0920-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:04 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 1073741824" returned: 0 in 1.131s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:04 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 Sep 28 16:03:04 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eca91d91-50be-4120-b38e-b3943ce16561 tempest-VolumesActionsTest-445219964 None] Acquiring lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" by "attach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:05 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (dd2839e8-b46d-48a6-8f86-2d1050ef255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88869afa-a22b-4962-8508-f184ea83c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eca91d91-50be-4120-b38e-b3943ce16561 tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" acquired by "attach_volume" :: waited 0.103s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5" returned: 0 in 0.622s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88869afa-a22b-4962-8508-f184ea83c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823833482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:05Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e84406c-ca89-4409-be62-63f0c3b7339c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e84406c-ca89-4409-be62-63f0c3b7339c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7578272b-cbfe-40e7-a8d7-34301bced906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7578272b-cbfe-40e7-a8d7-34301bced906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50', 'volume_name': 'volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2924c2b-d4f9-4f3a-9cff-6f9a327a7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2924c2b-d4f9-4f3a-9cff-6f9a327a7275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e5d431-cda8-456b-b0d1-25090414782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Volume 23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50', 'volume_size': 1} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823833482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:05Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Creating volume 23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9c4b5-5b0a-4a26-9337-cefe794e72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1755ac34-cb56-424e-a5a9-cb7c27c8ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:05 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 1073741824 Sep 28 16:03:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Volume volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 (edf1b76d-a2fe-44f2-87e5-b271ad9aefc5): created successfully Sep 28 16:03:05 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1755ac34-cb56-424e-a5a9-cb7c27c8ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Flow 'volume_create_manager' (1e84f17d-b5f7-4d17-8aaa-50b107d14893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f6ca55d5-974c-4c87-8858-b5dbf4dd088b tempest-AttachVolumeTestJSON-693345857 None] Created volume successfully. Sep 28 16:03:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-eca91d91-50be-4120-b38e-b3943ce16561 tempest-VolumesActionsTest-445219964 None] Attaching volume e655f07a-ffbe-4fe3-a297-f0506ab0b32d to instance f42a6187-0c7c-47ed-9d11-f2aeb074959c at mountpoint /dev/vdb on host None. Sep 28 16:03:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-eca91d91-50be-4120-b38e-b3943ce16561 tempest-VolumesActionsTest-445219964 None] Attach volume completed successfully. Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eca91d91-50be-4120-b38e-b3943ce16561 tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" released by "attach_volume" :: held 0.330s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:05 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 1073741824" returned: 0 in 0.765s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:06 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 Sep 28 16:03:06 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d6c175cf-9355-444b-a8dc-fe81c3226a0d tempest-VolumesActionsTest-445219964 None] Acquiring lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-detach_volume" by "detach_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d6c175cf-9355-444b-a8dc-fe81c3226a0d tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d6c175cf-9355-444b-a8dc-fe81c3226a0d tempest-VolumesActionsTest-445219964 None] Detaching volume e655f07a-ffbe-4fe3-a297-f0506ab0b32d from instance f42a6187-0c7c-47ed-9d11-f2aeb074959c. Sep 28 16:03:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d6c175cf-9355-444b-a8dc-fe81c3226a0d tempest-VolumesActionsTest-445219964 None] Detach volume completed successfully. Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d6c175cf-9355-444b-a8dc-fe81c3226a0d tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-detach_volume" released by "detach_volume" :: held 0.138s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:06 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50" returned: 0 in 0.591s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e5d431-cda8-456b-b0d1-25090414782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01ea522-ee8d-454d-b367-035037b3aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Volume volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 (23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50): created successfully Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01ea522-ee8d-454d-b367-035037b3aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (dd2839e8-b46d-48a6-8f86-2d1050ef255e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2e9caeae-43e2-4f5e-881c-6fe9c165e3ad tempest-VolumesActionsTest-212877458 None] Created volume successfully. Sep 28 16:03:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Lock "cinder-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Acquiring lock "cinder-quobyte-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50" acquired by "delete_volume" :: waited 0.065s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:07 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f7119-6da4-4e2a-94ce-3a41ac1df8a1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:07 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 Sep 28 16:03:07 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-16c439ae-1bac-47aa-ad69-58cae5726af1 req-ea6522c0-84b4-435d-ae75-4a498f77d31f tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-16c439ae-1bac-47aa-ad69-58cae5726af1 req-ea6522c0-84b4-435d-ae75-4a498f77d31f tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-16c439ae-1bac-47aa-ad69-58cae5726af1 req-ea6522c0-84b4-435d-ae75-4a498f77d31f tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-16c439ae-1bac-47aa-ad69-58cae5726af1 req-ea6522c0-84b4-435d-ae75-4a498f77d31f tempest-AttachVolumeTestJSON-693345857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c41594a8-3c13-4956-afc1-2476099e2a79', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:03:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-16c439ae-1bac-47aa-ad69-58cae5726af1 req-ea6522c0-84b4-435d-ae75-4a498f77d31f tempest-AttachVolumeTestJSON-693345857 None] attachment_update completed successfully. Sep 28 16:03:08 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50" returned: 0 in 0.755s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:08 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50 Sep 28 16:03:08 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:08 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50" returned: 0 in 0.567s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Lock "cinder-quobyte-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50" released by "delete_volume" :: held 1.425s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Created reservations ['72ea89c2-1fd0-42eb-bd47-24b3c94ccabb', '2e590b68-a821-4d28-9758-eb26529c22e6', 'fa480655-164a-468f-89bf-cebc015c244c', 'b3de306d-d186-4eee-9ddf-f1dfdce58dbc'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:09 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:03:09 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:09 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.441s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:09 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Deleted volume successfully. Sep 28 16:03:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f7865ca7-8b51-46b8-9610-f75f6087b1a9 tempest-VolumesActionsTest-392469858 None] Lock "cinder-23dfdbaf-bef1-41d7-8fa0-bbd3253e2d50-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (719c5b12-7866-4da6-b879-22c2b648f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa04965-5503-421c-9e50-86e6b95ae45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa04965-5503-421c-9e50-86e6b95ae45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380158798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ad15ef-46e8-4e9c-b7ba-161ddbba0e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:11Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ff099e-3300-433f-8f5a-1a3e86691c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ff099e-3300-433f-8f5a-1a3e86691c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b959c4b-7303-47ae-a4a1-d53359c3eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b959c4b-7303-47ae-a4a1-d53359c3eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ad15ef-46e8-4e9c-b7ba-161ddbba0e91', 'volume_name': 'volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe405da-9bcc-4a26-b158-5a44f672b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe405da-9bcc-4a26-b158-5a44f672b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e96abc-3811-40a8-892a-2a187f4d3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Volume 29ad15ef-46e8-4e9c-b7ba-161ddbba0e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91', 'volume_size': 1} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380158798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ad15ef-46e8-4e9c-b7ba-161ddbba0e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f97dc389a44608e7c83a5c8023bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:11Z,use_quota=True,user_id='973b52eb819841d0887eac09b6b5af5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Creating volume 29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:10 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:03:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:10 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 1073741824 Sep 28 16:03:10 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:11 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 1073741824" returned: 0 in 0.655s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Flow 'volume_create_manager' (6433b5e5-aa04-470f-85d8-c23aabda384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9d1762-c208-4de6-9ac1-0e0e0fcade20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9d1762-c208-4de6-9ac1-0e0e0fcade20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1576064067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa9ea68-9d90-431f-b559-c38df7169453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad28f55cb4c5457f942c248f53c153b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:11Z,use_quota=True,user_id='e5e342ed863c4b5681e654296f7d04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56adfd74-219f-43a8-ad46-3ce92813a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56adfd74-219f-43a8-ad46-3ce92813a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655d5bb4-ede3-4ef8-a419-98a8baa3a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655d5bb4-ede3-4ef8-a419-98a8baa3a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa9ea68-9d90-431f-b559-c38df7169453', 'volume_name': 'volume-daa9ea68-9d90-431f-b559-c38df7169453', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d31933-3fc6-4e6b-83f2-f0a48dc8ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d31933-3fc6-4e6b-83f2-f0a48dc8ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00995885-7c6c-4576-b2e5-0dfd4f2aa44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Volume daa9ea68-9d90-431f-b559-c38df7169453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa9ea68-9d90-431f-b559-c38df7169453', 'volume_size': 1} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:11 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 Sep 28 16:03:11 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:11 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1576064067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa9ea68-9d90-431f-b559-c38df7169453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad28f55cb4c5457f942c248f53c153b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:11Z,use_quota=True,user_id='e5e342ed863c4b5681e654296f7d04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Creating volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:11 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e96abc-3811-40a8-892a-2a187f4d3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2892bfdb-6ac1-4239-9da0-1aa4392f8bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:11 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 1073741824 Sep 28 16:03:11 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Volume volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 (29ad15ef-46e8-4e9c-b7ba-161ddbba0e91): created successfully Sep 28 16:03:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2892bfdb-6ac1-4239-9da0-1aa4392f8bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Flow 'volume_create_manager' (719c5b12-7866-4da6-b879-22c2b648f36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e660eae5-6b93-41ae-ae05-e17ab8d04372 tempest-VolumesActionsTest-212877458 None] Created volume successfully. Sep 28 16:03:12 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 1073741824" returned: 0 in 0.707s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:12 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 Sep 28 16:03:12 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:13 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453" returned: 0 in 0.434s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00995885-7c6c-4576-b2e5-0dfd4f2aa44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa9ea68-9d90-431f-b559-c38df7169453', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a3f87a-34ee-449f-98aa-e540693fbf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Volume volume-daa9ea68-9d90-431f-b559-c38df7169453 (daa9ea68-9d90-431f-b559-c38df7169453): created successfully Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a3f87a-34ee-449f-98aa-e540693fbf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Flow 'volume_create_manager' (6433b5e5-aa04-470f-85d8-c23aabda384e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ef22f9ba-dddf-4cdf-9ee1-d0d07c863668 tempest-VolumesSnapshotListTestJSON-1027638538 None] Created volume successfully. Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9fd75a-0e51-4c58-9ec0-295b035cdf7f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:14 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:03:14 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Acquiring lock "cinder-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Lock "cinder-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Acquiring lock "cinder-quobyte-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Lock "cinder-quobyte-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91" acquired by "delete_volume" :: waited 0.049s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a385bf7-ee67-45f0-8356-31309ac715a7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:14 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 Sep 28 16:03:14 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:14 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.652s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[106ad16c-5281-47e4-8fd8-a202c01f4fd0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:14 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:03:14 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:15 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91" returned: 0 in 0.615s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:15 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91 Sep 28 16:03:15 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:15 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.510s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.8092ae78-a77a-438f-980f-eca27b469602_dj5tc0p.img {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:15 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.8092ae78-a77a-438f-980f-eca27b469602_dj5tc0p.img Sep 28 16:03:15 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:15 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91" returned: 0 in 0.381s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Lock "cinder-quobyte-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91" released by "delete_volume" :: held 1.097s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Created reservations ['ff2fd76e-aba5-428d-a9a2-ef96abf87f1d', 'fa0aea6e-48e8-480e-b93a-2583b19d55ea', 'e0607071-bb3b-4f32-aa8c-4f66de2f469a', 'bd1e5abb-d213-41aa-b131-995fa4d0b7ba'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:15 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:03:15 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:16 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.733s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Deleted volume successfully. Sep 28 16:03:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a4295379-da4e-4ce7-8e3f-e0afc2234df5 tempest-VolumesActionsTest-212877458 None] Lock "cinder-29ad15ef-46e8-4e9c-b7ba-161ddbba0e91-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:25 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=87,cinder:INSERT=25,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:26 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.8092ae78-a77a-438f-980f-eca27b469602_dj5tc0p.img" returned: 0 in 10.823s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d66100-2ca3-430a-a396-899eb65bb5f5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:26 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:03:26 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=143,cinder:SELECT=116,cinder:DELETE=11,cinder:INSERT=40 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:26 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:03:26 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:26 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.742s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d, size 1024.00 MB, duration 10.83 sec, destination /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.8092ae78-a77a-438f-980f-eca27b469602_dj5tc0p.img {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:03:26 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Converted 1024.00 MB image at 94.60 MB/s Sep 28 16:03:26 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] 8092ae78-a77a-438f-980f-eca27b469602 was raw, no need to convert to raw {{(pid=86628) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 16:03:27 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:03:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:03:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:03:36 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Flow 'volume_create_manager' (b20bd6b7-9f8b-47ce-b177-6bb4f13df469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7ced50-8e37-4fbf-8b7b-af455cd0aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7ced50-8e37-4fbf-8b7b-af455cd0aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-561891243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40cfb4a-c113-460a-b1de-ce037724e889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234267718aff47b196b25d3ef8b35477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:44Z,use_quota=True,user_id='a405be43bf2c49f5a61155c55042ab80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0304fe0a-ecff-4dc9-b8c2-5f3c9428bf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0304fe0a-ecff-4dc9-b8c2-5f3c9428bf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7919679e-9e10-4629-b52b-ce2045e258e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:43 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7919679e-9e10-4629-b52b-ce2045e258e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f40cfb4a-c113-460a-b1de-ce037724e889', 'volume_name': 'volume-f40cfb4a-c113-460a-b1de-ce037724e889', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd02871-b94e-4b36-bcb6-765afbfe17d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd02871-b94e-4b36-bcb6-765afbfe17d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b325f6-68cc-4a7b-93d5-0cf67039c855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:44 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Volume f40cfb4a-c113-460a-b1de-ce037724e889: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f40cfb4a-c113-460a-b1de-ce037724e889', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Trying to clone f40cfb4a-c113-460a-b1de-ce037724e889 from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:03:44 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[482f7839-fc5a-464f-b8b6-b7451e87b158]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:44 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD Sep 28 16:03:44 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:45 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 is fetched for user a405be43bf2c49f5a61155c55042ab80. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ded2b-9f15-4203-b71d-cf511c675bc1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:45 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD Sep 28 16:03:45 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:45 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:45 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-7f19d434-8cc1-4f94-bd82-8b3905138196 req-ae424e8f-ee34-4cef-bb80-3e1ae7414e01 tempest-AttachVolumeTestJSON-693345857 None] Terminate volume connection completed successfully. Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-7f19d434-8cc1-4f94-bd82-8b3905138196 req-ae424e8f-ee34-4cef-bb80-3e1ae7414e01 tempest-AttachVolumeTestJSON-693345857 None] Deleting attachment c41594a8-3c13-4956-afc1-2476099e2a79. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.945s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Uploaded volume to glance image-id: 8092ae78-a77a-438f-980f-eca27b469602. {{(pid=86628) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:03:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 39.767s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Creating offline snapshot ab33c262-2b78-4c64-a960-c02534564501 of volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:03:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-526b29be-5cdc-4645-9dbb-f963b54b3141 tempest-VolumesActionsTest-445219964 None] Copy volume to image completed successfully. Sep 28 16:03:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[314e14fd-502a-4142-a65b-55f86cb1ba94]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:54 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 Sep 28 16:03:54 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:54 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453" returned: 0 in 0.463s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:54 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 1G Sep 28 16:03:54 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:55 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 1G" returned: 0 in 0.567s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:55 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:03:55 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:55 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:55 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 is being set with open permissions: ugo+rw Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:55 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:03:55 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:55 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.390s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:56 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info Sep 28 16:03:56 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:56 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info" returned: 0 in 0.333s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:56 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info is being set with open permissions: ugo+rw Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:56 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info Sep 28 16:03:56 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:56 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.info" returned: 0 in 0.274s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.909s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-561891243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40cfb4a-c113-460a-b1de-ce037724e889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234267718aff47b196b25d3ef8b35477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:44Z,use_quota=True,user_id='a405be43bf2c49f5a61155c55042ab80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Creating volume f40cfb4a-c113-460a-b1de-ce037724e889 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:56 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:03:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:56 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 1073741824 Sep 28 16:03:56 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cbe52d20-d047-4701-89a8-6594dea19701 tempest-VolumesSnapshotListTestJSON-1027638538 None] Create snapshot completed successfully Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:57 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 1073741824" returned: 0 in 0.622s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:57 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 Sep 28 16:03:57 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:57 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889" returned: 0 in 0.253s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.156s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5878af2d-2306-441e-8db7-aa65c57ce006]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Attempting download of dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume f40cfb4a-c113-460a-b1de-ce037724e889. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc193fea-8a8c-46bc-abc6-487df13b601c]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:57 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:03:57 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:57 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1 Sep 28 16:03:57 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:58 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.443s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5123a27-8c69-427a-80e4-aa255d5238b8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:58 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1" returned: 0 in 0.392s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:58 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:03:58 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:58 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1 Sep 28 16:03:58 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:58 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.467s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:58 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1" returned: 1 in 0.462s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_v376u5k1' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab3ff6e-cf79-4668-8d89-d85e83b4ddc6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:58 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img Sep 28 16:03:58 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:58 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD Sep 28 16:03:58 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:59 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:59 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 was qcow2, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:03:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:59 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 Sep 28 16:03:59 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:06 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889" returned: 0 in 7.214s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:06 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_7xcm8jkwdevstack@QuobyteHD, size 112.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:04:06 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Converted 112.00 MB image at 15.52 MB/s Sep 28 16:04:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:06 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 1G Sep 28 16:04:06 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:07 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 1G" returned: 0 in 0.800s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Downloaded image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume f40cfb4a-c113-460a-b1de-ce037724e889 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 for user a405be43bf2c49f5a61155c55042ab80 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Marking volume f40cfb4a-c113-460a-b1de-ce037724e889 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Copying metadata from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 to f40cfb4a-c113-460a-b1de-ce037724e889. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Creating volume glance metadata for volume f40cfb4a-c113-460a-b1de-ce037724e889 backed by image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b325f6-68cc-4a7b-93d5-0cf67039c855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40cfb4a-c113-460a-b1de-ce037724e889', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21424f6e-6d7d-40a8-8a35-c2fa3e3283f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Volume volume-f40cfb4a-c113-460a-b1de-ce037724e889 (f40cfb4a-c113-460a-b1de-ce037724e889): created successfully Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21424f6e-6d7d-40a8-8a35-c2fa3e3283f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Flow 'volume_create_manager' (b20bd6b7-9f8b-47ce-b177-6bb4f13df469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d8f59ce0-aa18-477d-adec-fd330da8c942 tempest-VolumesImageMetadata-539931582 None] Created volume successfully. Sep 28 16:04:08 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img" returned: 0 in 9.755s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b94ae-969b-466b-8a8e-f8283646c848]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:08 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:04:08 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Acquiring lock "cinder-f40cfb4a-c113-460a-b1de-ce037724e889-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Lock "cinder-f40cfb4a-c113-460a-b1de-ce037724e889-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Acquiring lock "cinder-quobyte-f40cfb4a-c113-460a-b1de-ce037724e889" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Lock "cinder-quobyte-f40cfb4a-c113-460a-b1de-ce037724e889" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:08 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.660s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d, size 1024.00 MB, duration 9.76 sec, destination /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:04:08 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Converted 1024.00 MB image at 104.95 MB/s Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] c00fb5e0-3df7-46b2-8328-e9a9e8e813fe was raw, converting to qcow2 {{(pid=86628) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98818c-2318-4899-bfaf-1a04370dd606]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ffc62a-effd-40e6-9c93-677cfd463b04]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:09 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 Sep 28 16:04:09 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:09 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img Sep 28 16:04:09 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:09 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img" returned: 0 in 0.364s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:09 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889" returned: 0 in 0.432s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:09 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889 Sep 28 16:04:09 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:09 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img Sep 28 16:04:09 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:09 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:09 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img" returned: 1 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f40cfb4a-c113-460a-b1de-ce037724e889" returned: 0 in 0.294s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Lock "cinder-quobyte-f40cfb4a-c113-460a-b1de-ce037724e889" released by "delete_volume" :: held 0.776s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:09 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8 Sep 28 16:04:09 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Created reservations ['837f6d79-6d32-4526-947a-255eb3d41017', '0ec86562-0e6b-472b-86f8-5f7469c3a1fc', '6878e30b-b03b-40fc-88dd-99e2fe404094', '32d4c79d-57cb-4190-aabf-c043819ab91d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:09 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:09 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:09 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:09 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Image conversion details: src /opt/stack/data/cinder/conversion/e655f07a-ffbe-4fe3-a297-f0506ab0b32d.temp_image.c00fb5e0-3df7-46b2-8328-e9a9e8e813fe5xh9ihvz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:04:09 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 16:04:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ea487b-01ea-409c-88bc-4107b092fcf0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:10 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8 Sep 28 16:04:10 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:10 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.363s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:10 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Deleted volume successfully. Sep 28 16:04:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a66727aa-90cb-438c-a352-42b394343d8d tempest-VolumesImageMetadata-539931582 None] Lock "cinder-f40cfb4a-c113-460a-b1de-ce037724e889-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:10 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rtnrf5e8" returned: 0 in 0.493s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.867s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Uploaded volume to glance image-id: c00fb5e0-3df7-46b2-8328-e9a9e8e813fe. {{(pid=86628) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:04:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.181s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Creating offline snapshot fec189bd-4bd8-4bf1-a4f5-d68656399fae of volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:04:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9df85c1c-9122-4435-961f-a4f23430defd tempest-VolumesActionsTest-445219964 None] Copy volume to image completed successfully. Sep 28 16:04:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dcd4db-87f9-4cc9-9dd8-d7433e14eed4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:12 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:04:12 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:13 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:13 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae 1G Sep 28 16:04:13 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:13 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae 1G" returned: 0 in 0.612s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:13 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:13 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:14 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.459s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:14 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae is being set with open permissions: ugo+rw Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:14 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:14 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Acquiring lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:14 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.471s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Acquiring lock "cinder-quobyte-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:14 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3e1c47f1-6551-4d95-949f-5708e4b61761 tempest-VolumesSnapshotListTestJSON-1027638538 None] Create snapshot completed successfully Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Lock "cinder-quobyte-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f5e06-bf98-473e-9091-4b2e5eb01518]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:14 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:04:14 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:15 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.524s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:15 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d Sep 28 16:04:15 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:15 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" returned: 0 in 0.433s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Lock "cinder-quobyte-e655f07a-ffbe-4fe3-a297-f0506ab0b32d" released by "delete_volume" :: held 1.054s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Creating offline snapshot a3399ef5-d536-40e6-86aa-a6b88ef5242d of volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d4de4-2d08-43b7-bbb4-f197794e1a7b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Created reservations ['8bc82a38-baf3-433a-a359-7a6efaa14032', '8e1e5da1-3403-4565-9594-4606d8cb17dd', 'e7904718-1ce1-451e-ac20-42db3baaebc4', 'be80ab77-a4d9-4277-822b-79c81e740f8b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:16 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:16 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:16 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:16 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:16 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.547s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:16 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d 1G Sep 28 16:04:16 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:16 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Flow 'volume_create_manager' (04d7fa8d-9637-49ef-a7b8-83138f18460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74380fb8-eab4-43dd-b25b-549f62ccf881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.468s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74380fb8-eab4-43dd-b25b-549f62ccf881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-771740656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d632915b-a314-422d-bb8e-d4dd59a21d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e896aae6f14f3fbe3f19f0cb8bd8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:17Z,use_quota=True,user_id='eca54779f0f049178fee5282939776f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25c4984-2d62-40ad-8490-229f064a8d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25c4984-2d62-40ad-8490-229f064a8d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0186a68c-71cb-479b-81fd-891e3cd00f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0186a68c-71cb-479b-81fd-891e3cd00f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd632915b-a314-422d-bb8e-d4dd59a21d27', 'volume_name': 'volume-d632915b-a314-422d-bb8e-d4dd59a21d27', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad8be53-2bf6-4e20-bcd8-2420692cd9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad8be53-2bf6-4e20-bcd8-2420692cd9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2a1bcf-9990-43a2-85bd-132dd7f19cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Volume d632915b-a314-422d-bb8e-d4dd59a21d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d632915b-a314-422d-bb8e-d4dd59a21d27', 'volume_size': 1} Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Deleted volume successfully. Sep 28 16:04:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9314d57b-b17c-4979-af2f-9e54d1999a68 tempest-VolumesActionsTest-445219964 None] Lock "cinder-e655f07a-ffbe-4fe3-a297-f0506ab0b32d-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:17 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d 1G" returned: 0 in 0.651s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:17 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d Sep 28 16:04:17 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:17 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d" returned: 0 in 0.401s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:17 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d is being set with open permissions: ugo+rw Sep 28 16:04:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:17 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d Sep 28 16:04:17 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:17 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d" returned: 0 in 0.360s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-771740656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d632915b-a314-422d-bb8e-d4dd59a21d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e896aae6f14f3fbe3f19f0cb8bd8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:17Z,use_quota=True,user_id='eca54779f0f049178fee5282939776f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Creating volume d632915b-a314-422d-bb8e-d4dd59a21d27 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:18 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:18 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 1073741824 Sep 28 16:04:18 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2faffa18-3583-4616-99e6-3e86247b3d38 tempest-VolumesSnapshotListTestJSON-1027638538 None] Create snapshot completed successfully Sep 28 16:04:18 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 1073741824" returned: 0 in 0.840s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:19 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 Sep 28 16:04:19 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:19 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27" returned: 0 in 0.523s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2a1bcf-9990-43a2-85bd-132dd7f19cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d632915b-a314-422d-bb8e-d4dd59a21d27', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f16d446-70b5-463d-9b46-8c2e743adf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:19 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Volume volume-d632915b-a314-422d-bb8e-d4dd59a21d27 (d632915b-a314-422d-bb8e-d4dd59a21d27): created successfully Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f16d446-70b5-463d-9b46-8c2e743adf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Flow 'volume_create_manager' (04d7fa8d-9637-49ef-a7b8-83138f18460d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d014c805-1e51-495b-bbef-ce2e8fe495c0 tempest-AbsoluteLimitsTests-1196652577 None] Created volume successfully. Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Acquiring lock "cinder-d632915b-a314-422d-bb8e-d4dd59a21d27-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Lock "cinder-d632915b-a314-422d-bb8e-d4dd59a21d27-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Acquiring lock "cinder-quobyte-d632915b-a314-422d-bb8e-d4dd59a21d27" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Lock "cinder-quobyte-d632915b-a314-422d-bb8e-d4dd59a21d27" acquired by "delete_volume" :: waited 0.017s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab23b53-4409-49f1-b3d1-56806afde127]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:20 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 Sep 28 16:04:20 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-a3399ef5-d536-40e6-86aa-a6b88ef5242d-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-a3399ef5-d536-40e6-86aa-a6b88ef5242d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-a3399ef5-d536-40e6-86aa-a6b88ef5242d" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-a3399ef5-d536-40e6-86aa-a6b88ef5242d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Deleting offline snapshot a3399ef5-d536-40e6-86aa-a6b88ef5242d of volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] snapshot_file for this snap is: volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e2198-4e6a-4b3f-8c17-dd1e6ce45ff9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:20 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:20 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d Sep 28 16:04:20 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:20 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27 Sep 28 16:04:20 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:21 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d632915b-a314-422d-bb8e-d4dd59a21d27" returned: 0 in 0.308s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Lock "cinder-quobyte-d632915b-a314-422d-bb8e-d4dd59a21d27" released by "delete_volume" :: held 0.896s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Created reservations ['c2f98ffc-f4e1-44f4-8f52-3f34449a97ca', 'e64b2f8c-8236-40b8-882d-d573c2dc74bf', '4bcf5682-5c69-4dda-ae51-27db8daf2407', 'a8de16ff-2295-43e4-898c-d8e97f5c2ab6'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:21 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d" returned: 0 in 0.555s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c29cf34-865e-42de-bebc-8ff1c5aceea0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:21 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:21 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:21 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:21 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:21 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.285s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:21 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Deleted volume successfully. Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e43c3bff-cbef-4e00-8690-512766bccc29 tempest-AbsoluteLimitsTests-1196652577 None] Lock "cinder-d632915b-a314-422d-bb8e-d4dd59a21d27-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:21 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:21 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d Sep 28 16:04:21 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:22 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d" returned: 0 in 0.697s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:22 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d Sep 28 16:04:22 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:22 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.a3399ef5-d536-40e6-86aa-a6b88ef5242d" returned: 0 in 0.345s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-a3399ef5-d536-40e6-86aa-a6b88ef5242d" released by "_delete_snapshot" :: held 2.180s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" released by "delete_snapshot" :: held 2.204s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:23 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Created reservations ['5b3a5609-6651-4d90-9191-3ae8d9bbb6d3', '2f61fd9b-7d5c-4dd0-bf52-f683ee710f31', '1a748081-c129-48c0-a607-ba9cc36bcaa0', '1b58e899-1b9a-4184-9a19-ed934d827ce8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Delete snapshot completed successfully. Sep 28 16:04:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d3afede1-3d38-4608-9e37-8ac2e532a05e tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-a3399ef5-d536-40e6-86aa-a6b88ef5242d-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-fec189bd-4bd8-4bf1-a4f5-d68656399fae-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-fec189bd-4bd8-4bf1-a4f5-d68656399fae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-fec189bd-4bd8-4bf1-a4f5-d68656399fae" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-fec189bd-4bd8-4bf1-a4f5-d68656399fae" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Deleting offline snapshot fec189bd-4bd8-4bf1-a4f5-d68656399fae of volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] snapshot_file for this snap is: volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c57ebc-6ea3-43fe-a3c5-27f1a186fdf8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:24 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:24 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:24 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.515s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66028b-1f1f-42c7-b47a-03b8dfb1cbda]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:24 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:04:24 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:25 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.565s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:25 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:25 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:25 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.611s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:25 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae Sep 28 16:04:25 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:26 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.fec189bd-4bd8-4bf1-a4f5-d68656399fae" returned: 0 in 0.352s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-fec189bd-4bd8-4bf1-a4f5-d68656399fae" released by "_delete_snapshot" :: held 2.238s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" released by "delete_snapshot" :: held 2.282s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Created reservations ['04d5b4c8-5063-4dc0-ba0a-59e606741ad0', '8aac94e9-0b33-4693-9498-a09e20b383c8', 'dd267d6c-89ae-42cb-8d3a-3ffbce068cc1', '10cb9665-4764-42f7-949b-64927fb6fa6a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Delete snapshot completed successfully. Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0a35730c-2b80-48e4-9158-c01c2282b720 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-fec189bd-4bd8-4bf1-a4f5-d68656399fae-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:26 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:26 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:27 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.405s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-ab33c262-2b78-4c64-a960-c02534564501-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-ab33c262-2b78-4c64-a960-c02534564501-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-ab33c262-2b78-4c64-a960-c02534564501" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-ab33c262-2b78-4c64-a960-c02534564501" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Deleting offline snapshot ab33c262-2b78-4c64-a960-c02534564501 of volume daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] snapshot_file for this snap is: volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f91ac8-ec23-4e4d-94f4-728c87e188dc]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:27 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:04:27 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:28 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.515s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daa9ea68-9d90-431f-b559-c38df7169453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f09715-9535-4324-bad3-33957963789e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:28 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 Sep 28 16:04:28 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:28 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453" returned: 0 in 0.522s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:28 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:04:28 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:29 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.548s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:29 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501 Sep 28 16:04:29 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:29 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453.ab33c262-2b78-4c64-a960-c02534564501" returned: 0 in 0.425s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-ab33c262-2b78-4c64-a960-c02534564501" released by "_delete_snapshot" :: held 2.197s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" released by "delete_snapshot" :: held 2.229s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Created reservations ['64017c60-1edb-4eb5-b19c-f7dcafe8db95', 'a3d13545-0b4a-43ac-bd17-457b465500e9', '09a8f2fc-40ae-454e-ad73-cd89d66e0070', '2c0bbb4d-ccc2-45fc-8952-a9ea29e47f27'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Delete snapshot completed successfully. Sep 28 16:04:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-c6bb0710-1947-4b60-8664-d35cbaad65d7 tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-ab33c262-2b78-4c64-a960-c02534564501-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-daa9ea68-9d90-431f-b559-c38df7169453-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-daa9ea68-9d90-431f-b559-c38df7169453-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:30 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1221d810-cefe-4781-9d93-abea772f0ec5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:31 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 Sep 28 16:04:31 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:31 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453" returned: 0 in 0.784s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:31 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453 Sep 28 16:04:31 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Flow 'volume_create_manager' (c2a0ad24-37fa-4d1e-a0ec-17ffdce8f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad8ee1d-153d-4684-be00-57063aee98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad8ee1d-153d-4684-be00-57063aee98d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1637099514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91129873-2465-46a7-9a4e-48a5d3cec0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3887d4d9cee4dc5a7d6807c3145c69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:32Z,use_quota=True,user_id='b6cfa09f2f3343d38d3bb6916dfc9297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa00bc82-210c-4605-b68b-120f0f894fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa00bc82-210c-4605-b68b-120f0f894fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57a2b14-2bc8-47ef-b729-960ae6d350a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57a2b14-2bc8-47ef-b729-960ae6d350a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91129873-2465-46a7-9a4e-48a5d3cec0ab', 'volume_name': 'volume-91129873-2465-46a7-9a4e-48a5d3cec0ab', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951a2928-871b-4b20-927c-5d2b83af0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951a2928-871b-4b20-927c-5d2b83af0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d3134f-fed4-42f8-aca4-593c116b75be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:31 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Volume 91129873-2465-46a7-9a4e-48a5d3cec0ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91129873-2465-46a7-9a4e-48a5d3cec0ab', 'volume_size': 1} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1637099514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91129873-2465-46a7-9a4e-48a5d3cec0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3887d4d9cee4dc5a7d6807c3145c69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:32Z,use_quota=True,user_id='b6cfa09f2f3343d38d3bb6916dfc9297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Creating volume 91129873-2465-46a7-9a4e-48a5d3cec0ab {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:31 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:32 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab 1073741824 Sep 28 16:04:32 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:32 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-daa9ea68-9d90-431f-b559-c38df7169453" returned: 0 in 0.682s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-quobyte-daa9ea68-9d90-431f-b559-c38df7169453" released by "delete_volume" :: held 1.620s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Created reservations ['112c99a4-aa30-488a-9813-2d7acccf7e3c', '230a9b76-cc97-416a-af7d-da77d7b8a3cf', '020ac92b-42d4-4704-a4c2-0d4fa67800fb', 'c9de08de-79e7-4a5e-9a60-2e1617433d99'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:32 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:32 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:33 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab 1073741824" returned: 0 in 1.084s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:33 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab Sep 28 16:04:33 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:33 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.545s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Deleted volume successfully. Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-59133d9e-7bb1-463d-8264-06f6797ee20b tempest-VolumesSnapshotListTestJSON-1027638538 None] Lock "cinder-daa9ea68-9d90-431f-b559-c38df7169453-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:33 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab" returned: 0 in 0.564s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d3134f-fed4-42f8-aca4-593c116b75be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91129873-2465-46a7-9a4e-48a5d3cec0ab', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaa4d36-7655-4bfb-959f-2a60e02aac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:33 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Volume volume-91129873-2465-46a7-9a4e-48a5d3cec0ab (91129873-2465-46a7-9a4e-48a5d3cec0ab): created successfully Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaa4d36-7655-4bfb-959f-2a60e02aac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:33 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Flow 'volume_create_manager' (c2a0ad24-37fa-4d1e-a0ec-17ffdce8f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5495040b-9ea0-4594-8e14-f00008e7e2e4 tempest-VolumesMetadataTest-819286722 None] Created volume successfully. Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Flow 'volume_create_manager' (19ca35a7-cb73-4208-a9b2-42cc4f98d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06f3921-1a5c-41e8-990b-259aa576abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06f3921-1a5c-41e8-990b-259aa576abf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-919967355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d95de8b-3e8d-4c92-a71f-e938c9875ea1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='579ee4cf2de0403da73a6a1cf923c62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:36Z,use_quota=True,user_id='095ea0d9cbf6462fb690f101248d70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00db9749-d837-4cbe-885c-8912ef09e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00db9749-d837-4cbe-885c-8912ef09e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b2313e-c2ae-47fd-b35b-c1aab17a8b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b2313e-c2ae-47fd-b35b-c1aab17a8b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d95de8b-3e8d-4c92-a71f-e938c9875ea1', 'volume_name': 'volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52552c0-df5d-46e2-86a3-b55c9332ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52552c0-df5d-46e2-86a3-b55c9332ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10954688-0728-47f3-ae3f-73f3f003ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:35 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Volume 2d95de8b-3e8d-4c92-a71f-e938c9875ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1', 'volume_size': 1} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-919967355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d95de8b-3e8d-4c92-a71f-e938c9875ea1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='579ee4cf2de0403da73a6a1cf923c62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:36Z,use_quota=True,user_id='095ea0d9cbf6462fb690f101248d70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Creating volume 2d95de8b-3e8d-4c92-a71f-e938c9875ea1 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:35 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:36 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 1073741824 Sep 28 16:04:36 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Acquiring lock "cinder-91129873-2465-46a7-9a4e-48a5d3cec0ab-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Lock "cinder-91129873-2465-46a7-9a4e-48a5d3cec0ab-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:36 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=59,cinder:SELECT=62,cinder:INSERT=23,cinder:DELETE=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:04:36 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:04:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Acquiring lock "cinder-quobyte-91129873-2465-46a7-9a4e-48a5d3cec0ab" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Lock "cinder-quobyte-91129873-2465-46a7-9a4e-48a5d3cec0ab" acquired by "delete_volume" :: waited 0.059s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a412748-3c36-4684-83cb-eef69e199051]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:37 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 1073741824" returned: 0 in 1.216s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:37 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:37 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:37 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 Sep 28 16:04:37 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:37 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab" returned: 0 in 0.621s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:37 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:37 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab Sep 28 16:04:37 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10954688-0728-47f3-ae3f-73f3f003ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdedc9d-9783-47e7-8198-312667898514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:37 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Volume volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 (2d95de8b-3e8d-4c92-a71f-e938c9875ea1): created successfully Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdedc9d-9783-47e7-8198-312667898514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Flow 'volume_create_manager' (19ca35a7-cb73-4208-a9b2-42cc4f98d867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e931dd26-a9b4-48bc-b651-6ed385543366 tempest-VolumesListTestJSON-255500871 None] Created volume successfully. Sep 28 16:04:38 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-91129873-2465-46a7-9a4e-48a5d3cec0ab" returned: 0 in 0.597s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Lock "cinder-quobyte-91129873-2465-46a7-9a4e-48a5d3cec0ab" released by "delete_volume" :: held 1.354s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Created reservations ['d2a6c798-7e27-43d4-a994-1ceb2eec3760', '323eaca1-e8e6-4f72-81e7-381702578c0f', '84a7fc08-0773-41c4-bc6e-db2c43631fb1', '72d50ac5-cba3-4be0-93ba-aed207730975'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:38 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:38 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:39 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.389s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Deleted volume successfully. Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1339395c-68a0-47bf-b750-175e8104967c tempest-VolumesMetadataTest-819286722 None] Lock "cinder-91129873-2465-46a7-9a4e-48a5d3cec0ab-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Flow 'volume_create_manager' (d3dccf52-ef60-4b79-ab90-52b9867e9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900d534a-8f8c-4398-95a4-3915eb768666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900d534a-8f8c-4398-95a4-3915eb768666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949316974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6063c93-54d1-4775-9dda-1957673053ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='579ee4cf2de0403da73a6a1cf923c62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:39Z,use_quota=True,user_id='095ea0d9cbf6462fb690f101248d70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63589bcc-6251-4026-8b3f-2a4f9c37db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63589bcc-6251-4026-8b3f-2a4f9c37db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cd2a11-a9f2-40e8-be90-e44cac6a3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cd2a11-a9f2-40e8-be90-e44cac6a3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6063c93-54d1-4775-9dda-1957673053ba', 'volume_name': 'volume-c6063c93-54d1-4775-9dda-1957673053ba', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27551168-24a5-4af9-a820-d276f786db39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27551168-24a5-4af9-a820-d276f786db39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23864abe-8850-4e18-8993-9ff08a031b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:39 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Volume c6063c93-54d1-4775-9dda-1957673053ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6063c93-54d1-4775-9dda-1957673053ba', 'volume_size': 1} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949316974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6063c93-54d1-4775-9dda-1957673053ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='579ee4cf2de0403da73a6a1cf923c62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:39Z,use_quota=True,user_id='095ea0d9cbf6462fb690f101248d70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Creating volume c6063c93-54d1-4775-9dda-1957673053ba {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:39 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:39 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba 1073741824 Sep 28 16:04:39 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:40 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba 1073741824" returned: 0 in 0.854s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:40 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba Sep 28 16:04:40 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:40 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba" returned: 0 in 0.479s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23864abe-8850-4e18-8993-9ff08a031b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6063c93-54d1-4775-9dda-1957673053ba', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0166a8cf-5d43-4c9d-8e77-6a261451515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:40 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Volume volume-c6063c93-54d1-4775-9dda-1957673053ba (c6063c93-54d1-4775-9dda-1957673053ba): created successfully Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0166a8cf-5d43-4c9d-8e77-6a261451515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Flow 'volume_create_manager' (d3dccf52-ef60-4b79-ab90-52b9867e9511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-98baafbd-d76f-4d8c-8dcc-62eecf138c95 tempest-VolumesListTestJSON-255500871 None] Created volume successfully. Sep 28 16:04:41 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Flow 'volume_create_manager' (5ececcc5-8849-48aa-8bd6-f6f324e18a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f08239-f8b8-4c1f-8da9-9fdfe47d5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f08239-f8b8-4c1f-8da9-9fdfe47d5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1933154833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7811849c-b993-4ee3-bfbe-ca80a018941c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418fde5256a4c7698628594437d845e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:42Z,use_quota=True,user_id='be9181e242c24fb7b8779d0bee73b932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904f2500-9381-4131-8837-6a5d27b74884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904f2500-9381-4131-8837-6a5d27b74884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d36e23-771b-444e-aa13-69fb8b87f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d36e23-771b-444e-aa13-69fb8b87f970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7811849c-b993-4ee3-bfbe-ca80a018941c', 'volume_name': 'volume-7811849c-b993-4ee3-bfbe-ca80a018941c', 'volume_size': 2}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed30eee0-c653-4c9b-bad6-e7d73b7030cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed30eee0-c653-4c9b-bad6-e7d73b7030cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab7733c-fcb0-44c5-8a66-f27dc722b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Volume 7811849c-b993-4ee3-bfbe-ca80a018941c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7811849c-b993-4ee3-bfbe-ca80a018941c', 'volume_size': 2} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1933154833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7811849c-b993-4ee3-bfbe-ca80a018941c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1418fde5256a4c7698628594437d845e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:42Z,use_quota=True,user_id='be9181e242c24fb7b8779d0bee73b932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Creating volume 7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:42 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c 2147483648 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:42 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c 2147483648 Sep 28 16:04:42 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Flow 'volume_create_manager' (f99611f5-7599-4671-8e9b-02b7e551ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c487e2c-9a66-4640-982f-dbff5768ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c487e2c-9a66-4640-982f-dbff5768ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1855022030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568ca503-4605-41f9-8215-c2d66a60b9a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='579ee4cf2de0403da73a6a1cf923c62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:43Z,use_quota=True,user_id='095ea0d9cbf6462fb690f101248d70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676f89f9-c009-4ef5-9918-7b85d8678cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676f89f9-c009-4ef5-9918-7b85d8678cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf08674f-f6b1-4785-a7e9-ce8c89587e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf08674f-f6b1-4785-a7e9-ce8c89587e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568ca503-4605-41f9-8215-c2d66a60b9a1', 'volume_name': 'volume-568ca503-4605-41f9-8215-c2d66a60b9a1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306b9fac-9829-4901-ad01-79146e7c9c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306b9fac-9829-4901-ad01-79146e7c9c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9fb22-e7c8-4fc6-93b5-594ab012e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:43 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Volume 568ca503-4605-41f9-8215-c2d66a60b9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568ca503-4605-41f9-8215-c2d66a60b9a1', 'volume_size': 1} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:43 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c 2147483648" returned: 0 in 1.028s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:43 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c Sep 28 16:04:43 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:43 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c" returned: 0 in 0.465s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1855022030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568ca503-4605-41f9-8215-c2d66a60b9a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='579ee4cf2de0403da73a6a1cf923c62d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:43Z,use_quota=True,user_id='095ea0d9cbf6462fb690f101248d70dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Creating volume 568ca503-4605-41f9-8215-c2d66a60b9a1 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:43 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:43 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 1073741824 Sep 28 16:04:43 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab7733c-fcb0-44c5-8a66-f27dc722b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7811849c-b993-4ee3-bfbe-ca80a018941c', 'volume_size': 2}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9772a329-35a0-4032-9d5d-389c3021287b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:44 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Volume volume-7811849c-b993-4ee3-bfbe-ca80a018941c (7811849c-b993-4ee3-bfbe-ca80a018941c): created successfully Sep 28 16:04:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9772a329-35a0-4032-9d5d-389c3021287b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Flow 'volume_create_manager' (5ececcc5-8849-48aa-8bd6-f6f324e18a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fb7f4001-9f32-456d-8ca1-48c1e9b4e246 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Created volume successfully. Sep 28 16:04:44 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 1073741824" returned: 0 in 1.108s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:45 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 Sep 28 16:04:45 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:45 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1" returned: 0 in 0.484s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9fb22-e7c8-4fc6-93b5-594ab012e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568ca503-4605-41f9-8215-c2d66a60b9a1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25c2abf-2df4-490a-8c94-bdad96c4c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:45 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Volume volume-568ca503-4605-41f9-8215-c2d66a60b9a1 (568ca503-4605-41f9-8215-c2d66a60b9a1): created successfully Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25c2abf-2df4-490a-8c94-bdad96c4c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Flow 'volume_create_manager' (f99611f5-7599-4671-8e9b-02b7e551ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:45 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1ef0a809-faf9-4567-964c-9a11e1977b93 tempest-VolumesListTestJSON-255500871 None] Created volume successfully. Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Creating offline snapshot 4db7691d-ce82-4376-81e9-5bdb7848bd0d of volume 7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:04:46 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09336e1-2b3d-445f-a26c-8a87e75c5ed8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:46 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c Sep 28 16:04:46 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:46 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c" returned: 0 in 0.786s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d 2G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:46 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d 2G Sep 28 16:04:46 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:47 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d 2G" returned: 0 in 0.769s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7811849c-b993-4ee3-bfbe-ca80a018941c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:47 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7811849c-b993-4ee3-bfbe-ca80a018941c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d Sep 28 16:04:47 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7811849c-b993-4ee3-bfbe-ca80a018941c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d" returned: 0 in 0.492s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d is being set with open permissions: ugo+rw Sep 28 16:04:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:48 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d Sep 28 16:04:48 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d" returned: 0 in 0.364s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:48 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info Sep 28 16:04:48 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:48 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info" returned: 0 in 0.472s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:48 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info is being set with open permissions: ugo+rw Sep 28 16:04:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:49 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info Sep 28 16:04:49 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:49 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.info" returned: 0 in 0.357s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.429s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9af34885-237e-45bc-a538-377d3fa7a1d1 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Create snapshot completed successfully Sep 28 16:04:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Acquiring lock "cinder-568ca503-4605-41f9-8215-c2d66a60b9a1-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Lock "cinder-568ca503-4605-41f9-8215-c2d66a60b9a1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Acquiring lock "cinder-quobyte-568ca503-4605-41f9-8215-c2d66a60b9a1" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Lock "cinder-quobyte-568ca503-4605-41f9-8215-c2d66a60b9a1" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6679cf3a-a816-49d0-9883-5f22c4caee0d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Flow 'volume_create_manager' (753daaa9-8953-4f01-96d2-1d52ae618613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080da68d-e60c-4177-b393-e01cf742e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080da68d-e60c-4177-b393-e01cf742e882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1076420315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eba578f-aa8f-4320-b4ad-b511ef99566d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb84d84f515148ecac81182faa39b6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:50Z,use_quota=True,user_id='b1cbbb7e475749e0abbf063bd912c665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:50 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 Sep 28 16:04:50 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd25454b-03f3-4a34-a3d5-7d40b1f68890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd25454b-03f3-4a34-a3d5-7d40b1f68890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afec2ddb-139b-412e-88e9-26e7b8901db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afec2ddb-139b-412e-88e9-26e7b8901db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eba578f-aa8f-4320-b4ad-b511ef99566d', 'volume_name': 'volume-9eba578f-aa8f-4320-b4ad-b511ef99566d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e2582b-35a5-4b78-82ba-d30f686669a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e2582b-35a5-4b78-82ba-d30f686669a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560ca74e-3cf9-4c15-97ba-c987eaa577db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Volume 9eba578f-aa8f-4320-b4ad-b511ef99566d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eba578f-aa8f-4320-b4ad-b511ef99566d', 'volume_size': 1} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1076420315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eba578f-aa8f-4320-b4ad-b511ef99566d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb84d84f515148ecac81182faa39b6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:50Z,use_quota=True,user_id='b1cbbb7e475749e0abbf063bd912c665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Creating volume 9eba578f-aa8f-4320-b4ad-b511ef99566d {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:50 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "cinder-4db7691d-ce82-4376-81e9-5bdb7848bd0d-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-4db7691d-ce82-4376-81e9-5bdb7848bd0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "cinder-quobyte-7811849c-b993-4ee3-bfbe-ca80a018941c" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:50 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d 1073741824 Sep 28 16:04:50 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-quobyte-7811849c-b993-4ee3-bfbe-ca80a018941c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "cinder-quobyte-4db7691d-ce82-4376-81e9-5bdb7848bd0d" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-quobyte-4db7691d-ce82-4376-81e9-5bdb7848bd0d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Deleting offline snapshot 4db7691d-ce82-4376-81e9-5bdb7848bd0d of volume 7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] snapshot_file for this snap is: volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c340863-1623-43af-b2e4-967ab479341e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:50 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1" returned: 0 in 0.529s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:50 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1 Sep 28 16:04:50 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d Sep 28 16:04:50 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:50 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d 1073741824" returned: 0 in 0.578s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:50 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-568ca503-4605-41f9-8215-c2d66a60b9a1" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Lock "cinder-quobyte-568ca503-4605-41f9-8215-c2d66a60b9a1" released by "delete_volume" :: held 0.926s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d Sep 28 16:04:51 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:51 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7811849c-b993-4ee3-bfbe-ca80a018941c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[89776455-a643-451d-9dd2-2bc24d43136b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Created reservations ['4e382323-bea9-4a37-87d3-ba4776601938', '7d65ae2d-3755-4441-93c1-2e135f3006b4', '57bb6c00-33a8-46f5-afef-80104f0c553c', '4cb1457b-24a3-4604-9d0c-bdbc8403cb8b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c Sep 28 16:04:51 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:51 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:51 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:51 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d" returned: 0 in 0.471s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560ca74e-3cf9-4c15-97ba-c987eaa577db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eba578f-aa8f-4320-b4ad-b511ef99566d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f44a118-b73c-41d2-896a-a6323763d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:51 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Volume volume-9eba578f-aa8f-4320-b4ad-b511ef99566d (9eba578f-aa8f-4320-b4ad-b511ef99566d): created successfully Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f44a118-b73c-41d2-896a-a6323763d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Flow 'volume_create_manager' (753daaa9-8953-4f01-96d2-1d52ae618613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8590b6cd-8ebe-4aa5-9dd4-9b5f18f39847 tempest-VolumesTransfersTest-1222666126 None] Created volume successfully. Sep 28 16:04:51 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Deleted volume successfully. Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b3064b54-6800-464c-a730-44edd8b2979e tempest-VolumesListTestJSON-255500871 None] Lock "cinder-568ca503-4605-41f9-8215-c2d66a60b9a1-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:51 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c" returned: 0 in 0.601s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d Sep 28 16:04:51 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:52 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d" returned: 0 in 0.401s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:52 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d Sep 28 16:04:52 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "cinder-c6063c93-54d1-4775-9dda-1957673053ba-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-c6063c93-54d1-4775-9dda-1957673053ba-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "cinder-quobyte-c6063c93-54d1-4775-9dda-1957673053ba" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-quobyte-c6063c93-54d1-4775-9dda-1957673053ba" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2692011a-0a71-4e86-ba45-417f228f4701]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:52 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c.4db7691d-ce82-4376-81e9-5bdb7848bd0d" returned: 0 in 0.575s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-quobyte-4db7691d-ce82-4376-81e9-5bdb7848bd0d" released by "_delete_snapshot" :: held 2.375s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:52 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba Sep 28 16:04:52 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-quobyte-7811849c-b993-4ee3-bfbe-ca80a018941c" released by "delete_snapshot" :: held 2.422s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:52 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Created reservations ['b2261001-7719-424a-bd7c-c67ef4476860', 'af106bfd-5406-4aa0-a81a-4dc176118276', '96b09654-faa7-4b48-a2ea-aa4b17fea9ea', '7a3f7e27-d2d0-4bbf-963d-d6f6c356b49f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Delete snapshot completed successfully. Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-13499b98-e555-4f01-98fc-dd8cf1ef57a7 tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-4db7691d-ce82-4376-81e9-5bdb7848bd0d-delete_snapshot" released by "delete_snapshot" :: held 2.726s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:53 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba" returned: 0 in 0.713s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:53 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba Sep 28 16:04:53 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bcaaaef3-af6a-40f5-afd4-4ef3833487ad tempest-VolumesTransfersTest-1916236059 None] Transfer volume completed successfully. Sep 28 16:04:53 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6063c93-54d1-4775-9dda-1957673053ba" returned: 0 in 0.510s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-quobyte-c6063c93-54d1-4775-9dda-1957673053ba" released by "delete_volume" :: held 1.308s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "cinder-7811849c-b993-4ee3-bfbe-ca80a018941c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-7811849c-b993-4ee3-bfbe-ca80a018941c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "cinder-quobyte-7811849c-b993-4ee3-bfbe-ca80a018941c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-quobyte-7811849c-b993-4ee3-bfbe-ca80a018941c" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Created reservations ['c7b00861-e212-4694-a3d1-fd371d326ba3', 'befad9ef-dc1c-45af-93cb-7bf5ffec500f', '4f565cdf-abb9-40dc-815a-d8531aaacadc', 'bafd5f41-882b-4fdd-9920-5796208cf0e1'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc48881-1ad1-436b-8761-06e23ed55e9e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:54 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c Sep 28 16:04:54 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:54 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:54 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:54 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.344s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Deleted volume successfully. Sep 28 16:04:54 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c" returned: 0 in 0.565s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ad5b81c9-24cf-486c-a6fc-d5a0c7e3bd17 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-c6063c93-54d1-4775-9dda-1957673053ba-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Acquiring lock "cinder-9eba578f-aa8f-4320-b4ad-b511ef99566d-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:54 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c Sep 28 16:04:54 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-9eba578f-aa8f-4320-b4ad-b511ef99566d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "cinder-2d95de8b-3e8d-4c92-a71f-e938c9875ea1-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-2d95de8b-3e8d-4c92-a71f-e938c9875ea1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Acquiring lock "cinder-quobyte-9eba578f-aa8f-4320-b4ad-b511ef99566d" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-quobyte-9eba578f-aa8f-4320-b4ad-b511ef99566d" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "cinder-quobyte-2d95de8b-3e8d-4c92-a71f-e938c9875ea1" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[472be456-81d6-4775-a48c-e80cf28203e1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-quobyte-2d95de8b-3e8d-4c92-a71f-e938c9875ea1" acquired by "delete_volume" :: waited 0.048s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbcad88-5fe3-4a59-8290-e7770c7d321f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:55 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d Sep 28 16:04:55 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:55 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7811849c-b993-4ee3-bfbe-ca80a018941c" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-quobyte-7811849c-b993-4ee3-bfbe-ca80a018941c" released by "delete_volume" :: held 1.150s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:55 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 Sep 28 16:04:55 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Created reservations ['60f49067-e943-46a0-8728-c2ea16abcb43', '0dc64dd4-bec7-441a-80e2-cf05458f3d48', '9f65776a-6fa9-498a-9843-4b6a9d064ea7', '1f9983c1-4b01-4a84-b610-525733583a56'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:55 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:55 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:55 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d" returned: 0 in 0.515s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:55 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d Sep 28 16:04:55 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:55 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1" returned: 0 in 0.519s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:55 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1 Sep 28 16:04:55 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:55 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.290s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Deleted volume successfully. Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-6d7c592a-e62a-4cc1-b34b-9f4f90d0a75e tempest-VolumesSnapshotNegativeTestJSON-1533825226 None] Lock "cinder-7811849c-b993-4ee3-bfbe-ca80a018941c-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:55 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9eba578f-aa8f-4320-b4ad-b511ef99566d" returned: 0 in 0.343s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-quobyte-9eba578f-aa8f-4320-b4ad-b511ef99566d" released by "delete_volume" :: held 0.937s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:55 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Created reservations ['2e99d981-a18c-4d2b-b86a-e2fa74b15df3', 'a17aa785-b730-4928-a57b-5a76e15e3db8', '615ae706-8201-460c-96ba-f92b1737a073', '09f0c0f2-3655-40f4-8940-1a8e478bfec9'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:56 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2d95de8b-3e8d-4c92-a71f-e938c9875ea1" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-quobyte-2d95de8b-3e8d-4c92-a71f-e938c9875ea1" released by "delete_volume" :: held 0.964s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Created reservations ['a51579bc-3709-41f4-a8cd-8f627859bdc1', '02c5d311-f656-487a-b4da-210b2b412063', 'd58eab70-355d-4d50-83e6-003fa122a862', 'e48bcba5-90fc-47c1-b33e-bb7c4b090578'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:04:56 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:56 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:56 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:04:56 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:56 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.390s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Deleted volume successfully. Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f27ec695-78a9-4cd1-b74c-cc5117331f96 tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-9eba578f-aa8f-4320-b4ad-b511ef99566d-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:56 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.344s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Deleted volume successfully. Sep 28 16:04:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2018e501-3eb1-472c-a8fd-23651b2585f4 tempest-VolumesListTestJSON-255500871 None] Lock "cinder-2d95de8b-3e8d-4c92-a71f-e938c9875ea1-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:04:57 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Flow 'volume_create_manager' (b1f02d1f-24d3-4c3b-9427-649d59cc2f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818c0b36-3c2c-449b-9efe-07ed22b95927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818c0b36-3c2c-449b-9efe-07ed22b95927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1468961702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e328b6-4ec8-4a5f-8d8c-b77c94deed98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb84d84f515148ecac81182faa39b6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:58Z,use_quota=True,user_id='b1cbbb7e475749e0abbf063bd912c665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff782f3-5c96-458c-8025-d034345fbdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff782f3-5c96-458c-8025-d034345fbdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97e8438-4e5c-4305-a19b-91bf0022f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97e8438-4e5c-4305-a19b-91bf0022f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e328b6-4ec8-4a5f-8d8c-b77c94deed98', 'volume_name': 'volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be089402-8370-4bff-87e0-5af02ee6f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be089402-8370-4bff-87e0-5af02ee6f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676e96c6-d734-443a-8845-69c388602de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Volume 01e328b6-4ec8-4a5f-8d8c-b77c94deed98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98', 'volume_size': 1} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1468961702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e328b6-4ec8-4a5f-8d8c-b77c94deed98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb84d84f515148ecac81182faa39b6ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:58Z,use_quota=True,user_id='b1cbbb7e475749e0abbf063bd912c665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Creating volume 01e328b6-4ec8-4a5f-8d8c-b77c94deed98 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:58 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 1073741824 Sep 28 16:04:58 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:58 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 1073741824" returned: 0 in 0.662s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:58 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 Sep 28 16:04:58 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:59 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676e96c6-d734-443a-8845-69c388602de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb33df-8380-4026-8e63-2254b8b21d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Volume volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 (01e328b6-4ec8-4a5f-8d8c-b77c94deed98): created successfully Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb33df-8380-4026-8e63-2254b8b21d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Flow 'volume_create_manager' (b1f02d1f-24d3-4c3b-9427-649d59cc2f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4a650954-3f27-43c4-ae07-61ac28b1f362 tempest-VolumesTransfersTest-1222666126 None] Created volume successfully. Sep 28 16:05:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Acquiring lock "cinder-01e328b6-4ec8-4a5f-8d8c-b77c94deed98-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-01e328b6-4ec8-4a5f-8d8c-b77c94deed98-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Acquiring lock "cinder-quobyte-01e328b6-4ec8-4a5f-8d8c-b77c94deed98" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-quobyte-01e328b6-4ec8-4a5f-8d8c-b77c94deed98" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[464319ab-76cb-4141-9444-932aa7f0a4f5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:00 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 Sep 28 16:05:00 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:01 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98" returned: 0 in 0.631s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:01 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98 Sep 28 16:05:01 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:01 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-01e328b6-4ec8-4a5f-8d8c-b77c94deed98" returned: 0 in 0.399s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-quobyte-01e328b6-4ec8-4a5f-8d8c-b77c94deed98" released by "delete_volume" :: held 1.133s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:01 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Created reservations ['69ad5040-d41a-494e-93d4-31e76db8249d', 'e8a8f770-495e-4345-bdda-31b0155141eb', '27259aff-18ed-43dd-9f4b-96f6f4f52877', 'b62f7622-5e20-4db3-b8bf-aeae19fb90df'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:02 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:02 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:02 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.446s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Deleted volume successfully. Sep 28 16:05:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9068416e-0671-4e26-b7aa-66c9691df54b tempest-VolumesTransfersTest-1552733518 None] Lock "cinder-01e328b6-4ec8-4a5f-8d8c-b77c94deed98-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Flow 'volume_create_manager' (054642bd-7940-49b8-b20d-2e0b8b2d46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b554ce8a-7ad3-420d-a46c-f1fa40129153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b554ce8a-7ad3-420d-a46c-f1fa40129153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1673940786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7139b35-4f61-4b42-b05b-b23aa60b8d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d39451304f43c29f1bfa78db3c622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:05Z,use_quota=True,user_id='19e3d73dec28488991b978fde4ba1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36a7c65-95f8-4277-bdff-c070631beea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36a7c65-95f8-4277-bdff-c070631beea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a88890-29b3-4628-9872-bbc735fe52c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a88890-29b3-4628-9872-bbc735fe52c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7139b35-4f61-4b42-b05b-b23aa60b8d39', 'volume_name': 'volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8360add6-2492-408c-a5b3-f2ca711142d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8360add6-2492-408c-a5b3-f2ca711142d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5835f91-ece5-4dfe-a73b-e5095d0b159d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Volume a7139b35-4f61-4b42-b05b-b23aa60b8d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39', 'volume_size': 1} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1673940786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7139b35-4f61-4b42-b05b-b23aa60b8d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d39451304f43c29f1bfa78db3c622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:05Z,use_quota=True,user_id='19e3d73dec28488991b978fde4ba1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Creating volume a7139b35-4f61-4b42-b05b-b23aa60b8d39 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:05:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:05 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 1073741824 Sep 28 16:05:05 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:06 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 1073741824" returned: 0 in 0.662s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:06 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 Sep 28 16:05:06 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:06 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39" returned: 0 in 0.413s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5835f91-ece5-4dfe-a73b-e5095d0b159d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61a5a93-f663-46a8-bc35-49097cdee0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Volume volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 (a7139b35-4f61-4b42-b05b-b23aa60b8d39): created successfully Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61a5a93-f663-46a8-bc35-49097cdee0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Flow 'volume_create_manager' (054642bd-7940-49b8-b20d-2e0b8b2d46b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c4e0fe9b-4ee6-424a-a836-34acdfdae80e tempest-AttachVolumeTestJSON-693345857 None] Created volume successfully. Sep 28 16:05:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4afe93d5-f16e-4f8f-841c-bb4c061ab309 req-52d2365e-bfee-4f9b-9506-33f5544805d9 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4afe93d5-f16e-4f8f-841c-bb4c061ab309 req-52d2365e-bfee-4f9b-9506-33f5544805d9 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4afe93d5-f16e-4f8f-841c-bb4c061ab309 req-52d2365e-bfee-4f9b-9506-33f5544805d9 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-4afe93d5-f16e-4f8f-841c-bb4c061ab309 req-52d2365e-bfee-4f9b-9506-33f5544805d9 tempest-AttachVolumeTestJSON-693345857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f387a33-79f7-46ac-819b-5e8a6e24f9d2', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:05:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-4afe93d5-f16e-4f8f-841c-bb4c061ab309 req-52d2365e-bfee-4f9b-9506-33f5544805d9 tempest-AttachVolumeTestJSON-693345857 None] attachment_update completed successfully. Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Flow 'volume_create_manager' (4b70f0a4-0ebf-4c64-b199-0816ef3d645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8571c44-fac5-47d8-9059-23ceb0261c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8571c44-fac5-47d8-9059-23ceb0261c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-130664640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bdd7b8-2592-40a0-8472-83d62b50a5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d39451304f43c29f1bfa78db3c622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:12Z,use_quota=True,user_id='19e3d73dec28488991b978fde4ba1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (178804e5-5b5d-4e2c-b3d3-c3e456ba6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (178804e5-5b5d-4e2c-b3d3-c3e456ba6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b06f556-c586-4474-aa4d-4af54830f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b06f556-c586-4474-aa4d-4af54830f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bdd7b8-2592-40a0-8472-83d62b50a5dc', 'volume_name': 'volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ee6498-d52f-448e-ba32-767adcfeb406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ee6498-d52f-448e-ba32-767adcfeb406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f4be6-ca6e-4a1b-8a3b-695c5b09af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Volume 25bdd7b8-2592-40a0-8472-83d62b50a5dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc', 'volume_size': 1} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-130664640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bdd7b8-2592-40a0-8472-83d62b50a5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d39451304f43c29f1bfa78db3c622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:12Z,use_quota=True,user_id='19e3d73dec28488991b978fde4ba1718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Creating volume 25bdd7b8-2592-40a0-8472-83d62b50a5dc {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:11 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:05:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:11 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc 1073741824 Sep 28 16:05:11 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:12 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc 1073741824" returned: 0 in 0.780s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:12 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc Sep 28 16:05:12 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:13 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc" returned: 0 in 0.396s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f4be6-ca6e-4a1b-8a3b-695c5b09af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721f401a-5505-4920-bec1-9c6e18d5d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Volume volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc (25bdd7b8-2592-40a0-8472-83d62b50a5dc): created successfully Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721f401a-5505-4920-bec1-9c6e18d5d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Flow 'volume_create_manager' (4b70f0a4-0ebf-4c64-b199-0816ef3d645d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-da57759c-2d34-4746-b1ee-f168009fd987 tempest-AttachVolumeTestJSON-693345857 None] Created volume successfully. Sep 28 16:05:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0229ff0a-8de5-4154-b1ea-1461202ed6ef req-a1c64d03-2e14-4604-be46-922f991b169d tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0229ff0a-8de5-4154-b1ea-1461202ed6ef req-a1c64d03-2e14-4604-be46-922f991b169d tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-0229ff0a-8de5-4154-b1ea-1461202ed6ef req-a1c64d03-2e14-4604-be46-922f991b169d tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-0229ff0a-8de5-4154-b1ea-1461202ed6ef req-a1c64d03-2e14-4604-be46-922f991b169d tempest-AttachVolumeTestJSON-693345857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1801759-1bcf-4eeb-a318-25b9d01dd838', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:05:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-0229ff0a-8de5-4154-b1ea-1461202ed6ef req-a1c64d03-2e14-4604-be46-922f991b169d tempest-AttachVolumeTestJSON-693345857 None] attachment_update completed successfully. Sep 28 16:05:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-51604703-eab2-45f7-9d91-d1fcf87d2d67 req-d0509330-0c98-4c20-b768-ae50691c04f8 tempest-AttachVolumeTestJSON-693345857 None] Terminate volume connection completed successfully. Sep 28 16:05:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-51604703-eab2-45f7-9d91-d1fcf87d2d67 req-d0509330-0c98-4c20-b768-ae50691c04f8 tempest-AttachVolumeTestJSON-693345857 None] Deleting attachment 0f387a33-79f7-46ac-819b-5e8a6e24f9d2. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:05:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-0f861325-d592-47b6-bc4d-d4f443d58973 req-e84f908d-8e2a-4ec8-b34d-178d3f351510 tempest-AttachVolumeTestJSON-693345857 None] Terminate volume connection completed successfully. Sep 28 16:05:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-0f861325-d592-47b6-bc4d-d4f443d58973 req-e84f908d-8e2a-4ec8-b34d-178d3f351510 tempest-AttachVolumeTestJSON-693345857 None] Deleting attachment e1801759-1bcf-4eeb-a318-25b9d01dd838. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:26 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:26 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:27 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.503s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:05:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:05:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Flow 'volume_create_manager' (6a9cec58-d204-48de-bdf9-200fa154eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea4898e-a4dc-4662-a6e5-104f5609e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea4898e-a4dc-4662-a6e5-104f5609e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1187102605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723ba34028342f0a83be97667c79aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:29Z,use_quota=True,user_id='445354411da04a7ea3c5b997ef106e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaeecf29-35bc-41cc-8f3b-7ab157479df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaeecf29-35bc-41cc-8f3b-7ab157479df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c9422f-7625-4360-a03d-27943f62d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c9422f-7625-4360-a03d-27943f62d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c', 'volume_name': 'volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba21261-6851-4d4a-84c1-7413d8567846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba21261-6851-4d4a-84c1-7413d8567846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254bd570-0cc9-490b-b35c-be7f64d629c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Volume ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c', 'volume_size': 1} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1187102605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723ba34028342f0a83be97667c79aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:29Z,use_quota=True,user_id='445354411da04a7ea3c5b997ef106e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Creating volume ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:28 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:05:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:28 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c 1073741824 Sep 28 16:05:28 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:29 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c 1073741824" returned: 0 in 0.822s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:29 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c Sep 28 16:05:29 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:30 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c" returned: 0 in 0.363s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254bd570-0cc9-490b-b35c-be7f64d629c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb19bc8-da4a-491b-9b62-d431f623e971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Volume volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c (ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c): created successfully Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb19bc8-da4a-491b-9b62-d431f623e971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Flow 'volume_create_manager' (6a9cec58-d204-48de-bdf9-200fa154eced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-116bf8f6-b234-48a1-8cd4-0884c39127f9 tempest-VolumesTransfersV355Test-1148085454 None] Created volume successfully. Sep 28 16:05:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c7ca6981-c744-447b-97f5-50d8098c80cb tempest-VolumesTransfersV355Test-1780744194 None] Transfer volume completed successfully. Sep 28 16:05:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Acquiring lock "cinder-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Acquiring lock "cinder-quobyte-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-quobyte-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:32 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26d0b35-60df-4376-98bb-c2726a4e0112]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:32 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c Sep 28 16:05:32 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:33 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c" returned: 0 in 0.557s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:33 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c Sep 28 16:05:33 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:33 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c" returned: 0 in 0.343s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-quobyte-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c" released by "delete_volume" :: held 0.975s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Created reservations ['9cccbc1c-c0ee-4b09-a7cb-6909824a5a09', 'cdde723a-dfd7-4fb3-bbb1-3352330702bd', '1bbc4656-8d19-40d3-b196-f58bb00e003d', '27c05cc2-6f74-4659-8b9b-4b03cb44e0d1'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:34 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:34 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:34 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.458s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:34 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Deleted volume successfully. Sep 28 16:05:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a23f8b6a-96be-4f4f-81d9-5d996e388e06 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-ae5f9a9e-3a2f-4e07-abe0-632ffccb8e2c-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "cinder-25bdd7b8-2592-40a0-8472-83d62b50a5dc-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-25bdd7b8-2592-40a0-8472-83d62b50a5dc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "cinder-quobyte-25bdd7b8-2592-40a0-8472-83d62b50a5dc" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-quobyte-25bdd7b8-2592-40a0-8472-83d62b50a5dc" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[25608679-7d3b-437f-9ac2-ba0fc2af25f8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Flow 'volume_create_manager' (409cfb9b-d73f-4803-be2a-b0a0de386f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926ec432-ff79-480b-8e18-029cd49a2abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:35 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc Sep 28 16:05:35 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926ec432-ff79-480b-8e18-029cd49a2abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-677846713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4562cd-8920-404b-a277-8777ee237965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723ba34028342f0a83be97667c79aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:36Z,use_quota=True,user_id='445354411da04a7ea3c5b997ef106e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e598f7-c6c1-41d2-b17d-c7cc6cae6769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e598f7-c6c1-41d2-b17d-c7cc6cae6769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74843635-240e-4aaf-90e7-186bea719d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74843635-240e-4aaf-90e7-186bea719d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4562cd-8920-404b-a277-8777ee237965', 'volume_name': 'volume-ea4562cd-8920-404b-a277-8777ee237965', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31788e0-0781-4013-a53f-b30f24f75105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31788e0-0781-4013-a53f-b30f24f75105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83706605-84e5-4fa2-b9dc-4c415af791a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:36 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Volume ea4562cd-8920-404b-a277-8777ee237965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4562cd-8920-404b-a277-8777ee237965', 'volume_size': 1} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-677846713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4562cd-8920-404b-a277-8777ee237965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723ba34028342f0a83be97667c79aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:36Z,use_quota=True,user_id='445354411da04a7ea3c5b997ef106e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Creating volume ea4562cd-8920-404b-a277-8777ee237965 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:36 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:36 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 1073741824 Sep 28 16:05:36 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:36 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc" returned: 0 in 0.676s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:36 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc Sep 28 16:05:36 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:36 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 1073741824" returned: 0 in 0.868s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:37 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-25bdd7b8-2592-40a0-8472-83d62b50a5dc" returned: 0 in 0.567s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:37 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 Sep 28 16:05:37 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-quobyte-25bdd7b8-2592-40a0-8472-83d62b50a5dc" released by "delete_volume" :: held 1.364s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=89,cinder:UPDATE=106,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=84,cinder:UPDATE=98,cinder:INSERT=22,cinder:DELETE=11 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Created reservations ['e47bf45e-161c-4742-9c56-1d2d0cf48618', 'bd0da649-629d-45d1-913f-328234ca58d8', 'a282d4ac-eb75-4dc4-9ea3-b6203cbd68b4', '668b646f-3c48-4c4b-9644-455010074902'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:37 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:37 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:37 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965" returned: 0 in 0.504s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83706605-84e5-4fa2-b9dc-4c415af791a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4562cd-8920-404b-a277-8777ee237965', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f900889b-2c3b-4b3b-a7cc-636d7e4f300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:37 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Volume volume-ea4562cd-8920-404b-a277-8777ee237965 (ea4562cd-8920-404b-a277-8777ee237965): created successfully Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f900889b-2c3b-4b3b-a7cc-636d7e4f300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Flow 'volume_create_manager' (409cfb9b-d73f-4803-be2a-b0a0de386f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-588eb8fa-f845-45c8-a84e-20d4df9f2f23 tempest-VolumesTransfersV355Test-1148085454 None] Created volume successfully. Sep 28 16:05:37 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Deleted volume successfully. Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ec73aa6a-b0a1-45a8-a889-7b6ec1fea570 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-25bdd7b8-2592-40a0-8472-83d62b50a5dc-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "cinder-a7139b35-4f61-4b42-b05b-b23aa60b8d39-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-a7139b35-4f61-4b42-b05b-b23aa60b8d39-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "cinder-quobyte-a7139b35-4f61-4b42-b05b-b23aa60b8d39" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-quobyte-a7139b35-4f61-4b42-b05b-b23aa60b8d39" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ec5cd1-1ff8-4803-920f-ec83b8d36ace]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:38 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 Sep 28 16:05:38 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Acquiring lock "cinder-ea4562cd-8920-404b-a277-8777ee237965-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-ea4562cd-8920-404b-a277-8777ee237965-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Acquiring lock "cinder-quobyte-ea4562cd-8920-404b-a277-8777ee237965" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-quobyte-ea4562cd-8920-404b-a277-8777ee237965" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090bd9c-4817-49e2-85b4-c87905162fd5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:38 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39" returned: 0 in 0.702s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:38 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39 Sep 28 16:05:38 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:39 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 Sep 28 16:05:39 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:39 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a7139b35-4f61-4b42-b05b-b23aa60b8d39" returned: 0 in 0.439s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-quobyte-a7139b35-4f61-4b42-b05b-b23aa60b8d39" released by "delete_volume" :: held 1.237s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:39 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965" returned: 0 in 0.570s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Created reservations ['1cc9c1b7-b81f-488f-8ae3-a7ffb0d9b8a9', '7fda92a0-4a08-4903-9119-33d8034c8ecf', '5fd4768d-31ff-4895-a8d0-96390d096ee3', '4867d513-7331-427b-857f-d77e5b89c02d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:39 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965 Sep 28 16:05:39 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:39 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:39 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:39 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ea4562cd-8920-404b-a277-8777ee237965" returned: 0 in 0.353s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-quobyte-ea4562cd-8920-404b-a277-8777ee237965" released by "delete_volume" :: held 0.991s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Created reservations ['03c390cc-7bb0-48dd-bac5-ddfe4ef85a05', '352f2aee-fdb1-4771-a69e-872251d88794', 'f4f6adbb-5511-4246-8767-c606e0f16dee', '7d41413f-3007-4f11-b8ea-f34a98c4db8a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:39 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.387s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:39 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Deleted volume successfully. Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2bdb8eff-e721-41f2-8a77-9106442c5308 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-a7139b35-4f61-4b42-b05b-b23aa60b8d39-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:40 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:40 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:40 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.377s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Deleted volume successfully. Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36a85a51-7071-48c0-96d2-d980ce3099b2 tempest-VolumesTransfersV355Test-1249621407 None] Lock "cinder-ea4562cd-8920-404b-a277-8777ee237965-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "cinder-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "cinder-quobyte-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-quobyte-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5" acquired by "delete_volume" :: waited 0.017s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3be37e-6087-41bb-932f-6de12d69afa8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:40 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 Sep 28 16:05:40 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:41 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5" returned: 0 in 0.746s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:41 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5 Sep 28 16:05:41 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:42 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5" returned: 0 in 0.526s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-quobyte-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5" released by "delete_volume" :: held 1.334s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Created reservations ['f29b0294-a914-4137-8f6b-15aed16d841b', '36cf75b5-7d25-4947-a5e1-d5145c78f38d', '6be7e4a4-d396-46ab-b87f-a6e3353029c4', '64d8c056-59c4-444d-bc18-bbdfe46198df'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:42 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:05:42 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:42 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Deleted volume successfully. Sep 28 16:05:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-246d9ee8-0c08-4456-9b7d-8a5542bc9377 tempest-AttachVolumeTestJSON-693345857 None] Lock "cinder-edf1b76d-a2fe-44f2-87e5-b271ad9aefc5-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:52 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:INSERT=7,cinder:UPDATE=36,cinder:SELECT=16 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=18,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=8 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:06:04 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Flow 'volume_create_manager' (22416ea2-04e7-407e-bb31-24e81af3da3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ff91bf-b7af-4c0a-8f28-7deb74b265de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ff91bf-b7af-4c0a-8f28-7deb74b265de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1014584837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82f7b81-40ce-425b-a580-8b155f88ab03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96ff9132a0d4516b49cc16e7f09b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:05Z,use_quota=True,user_id='d9ab6f21db0c41ecb51d25acd6dba3b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8593162-9817-4815-8c2d-787c0b8d564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8593162-9817-4815-8c2d-787c0b8d564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6cd2b8-13d5-4d19-a838-4b675e0f6452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6cd2b8-13d5-4d19-a838-4b675e0f6452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82f7b81-40ce-425b-a580-8b155f88ab03', 'volume_name': 'volume-c82f7b81-40ce-425b-a580-8b155f88ab03', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc61b12-ecbb-44ec-bf2f-1487acbf91ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc61b12-ecbb-44ec-bf2f-1487acbf91ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f24baf6-9f4f-4911-99da-63024a92a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Volume c82f7b81-40ce-425b-a580-8b155f88ab03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82f7b81-40ce-425b-a580-8b155f88ab03', 'volume_size': 1} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1014584837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82f7b81-40ce-425b-a580-8b155f88ab03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96ff9132a0d4516b49cc16e7f09b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:05Z,use_quota=True,user_id='d9ab6f21db0c41ecb51d25acd6dba3b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Creating volume c82f7b81-40ce-425b-a580-8b155f88ab03 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:06:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:05 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 1073741824 Sep 28 16:06:05 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:06 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 1073741824" returned: 0 in 0.978s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:06 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 Sep 28 16:06:06 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:06 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03" returned: 0 in 0.474s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f24baf6-9f4f-4911-99da-63024a92a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82f7b81-40ce-425b-a580-8b155f88ab03', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d43eb6-a556-4cdb-9eff-c2326ffb5ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Volume volume-c82f7b81-40ce-425b-a580-8b155f88ab03 (c82f7b81-40ce-425b-a580-8b155f88ab03): created successfully Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d43eb6-a556-4cdb-9eff-c2326ffb5ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Flow 'volume_create_manager' (22416ea2-04e7-407e-bb31-24e81af3da3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-52d9b6ee-2154-470f-aa8a-5cdfe1673a5c tempest-VolumesTransfersV357Test-260930296 None] Created volume successfully. Sep 28 16:06:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4465cb32-7c36-4491-acbf-f6ea2719fe8d tempest-VolumesTransfersV357Test-1578645819 None] Transfer volume completed successfully. Sep 28 16:06:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Acquiring lock "cinder-c82f7b81-40ce-425b-a580-8b155f88ab03-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-c82f7b81-40ce-425b-a580-8b155f88ab03-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Acquiring lock "cinder-quobyte-c82f7b81-40ce-425b-a580-8b155f88ab03" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-quobyte-c82f7b81-40ce-425b-a580-8b155f88ab03" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd58d43-51ed-47ce-9b0a-31c84ab9ac83]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:11 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 Sep 28 16:06:11 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:11 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03" returned: 0 in 0.962s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:11 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03 Sep 28 16:06:11 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:12 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c82f7b81-40ce-425b-a580-8b155f88ab03" returned: 0 in 0.485s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-quobyte-c82f7b81-40ce-425b-a580-8b155f88ab03" released by "delete_volume" :: held 1.588s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Created reservations ['9a07dc03-1171-4db8-b7ef-1a0c08b8f407', '667c9f75-5f07-4b97-a747-7988df084cde', '633e2e2f-039d-4b82-b13b-7bce49888373', '4ba67fae-5e1f-4ac5-9bcf-c4fe5ace54a0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:12 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:06:12 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:12 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.317s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:12 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Deleted volume successfully. Sep 28 16:06:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a82ea999-c911-499a-93e4-9125fd3d1813 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-c82f7b81-40ce-425b-a580-8b155f88ab03-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Flow 'volume_create_manager' (e9277831-fab5-432d-befa-9bced0a4d7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfa4cb3-2953-49ef-bd90-a223a18e7a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfa4cb3-2953-49ef-bd90-a223a18e7a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-790612991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b6a1e0-e073-40ae-997f-49848cb58404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96ff9132a0d4516b49cc16e7f09b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:14Z,use_quota=True,user_id='d9ab6f21db0c41ecb51d25acd6dba3b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e140663a-15b9-4df7-9ef8-81537eee3546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e140663a-15b9-4df7-9ef8-81537eee3546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b00b267-80af-4c92-8080-f61377b975f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b00b267-80af-4c92-8080-f61377b975f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b6a1e0-e073-40ae-997f-49848cb58404', 'volume_name': 'volume-a5b6a1e0-e073-40ae-997f-49848cb58404', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3792a22-0036-4148-9203-a8e58cb38188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3792a22-0036-4148-9203-a8e58cb38188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec10aaf-75d9-4fc0-84b4-0a878705088c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:14 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Volume a5b6a1e0-e073-40ae-997f-49848cb58404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b6a1e0-e073-40ae-997f-49848cb58404', 'volume_size': 1} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-790612991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b6a1e0-e073-40ae-997f-49848cb58404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96ff9132a0d4516b49cc16e7f09b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:14Z,use_quota=True,user_id='d9ab6f21db0c41ecb51d25acd6dba3b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Creating volume a5b6a1e0-e073-40ae-997f-49848cb58404 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:14 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:06:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:14 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 1073741824 Sep 28 16:06:14 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:15 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 1073741824" returned: 0 in 0.749s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:15 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 Sep 28 16:06:15 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:15 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404" returned: 0 in 0.359s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec10aaf-75d9-4fc0-84b4-0a878705088c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b6a1e0-e073-40ae-997f-49848cb58404', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ca3ee1-670c-4475-bf29-7df1fb24c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:15 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Volume volume-a5b6a1e0-e073-40ae-997f-49848cb58404 (a5b6a1e0-e073-40ae-997f-49848cb58404): created successfully Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ca3ee1-670c-4475-bf29-7df1fb24c44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Flow 'volume_create_manager' (e9277831-fab5-432d-befa-9bced0a4d7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-def40602-1bd7-4b32-b68c-aed35f356308 tempest-VolumesTransfersV357Test-260930296 None] Created volume successfully. Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Acquiring lock "cinder-a5b6a1e0-e073-40ae-997f-49848cb58404-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-a5b6a1e0-e073-40ae-997f-49848cb58404-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Acquiring lock "cinder-quobyte-a5b6a1e0-e073-40ae-997f-49848cb58404" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-quobyte-a5b6a1e0-e073-40ae-997f-49848cb58404" acquired by "delete_volume" :: waited 0.043s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6b684-b852-4959-b422-ab1dcfe080c3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:17 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 Sep 28 16:06:17 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:17 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404" returned: 0 in 0.619s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:17 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404 Sep 28 16:06:18 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:18 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a5b6a1e0-e073-40ae-997f-49848cb58404" returned: 0 in 0.565s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-quobyte-a5b6a1e0-e073-40ae-997f-49848cb58404" released by "delete_volume" :: held 1.306s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Flow 'volume_create_manager' (10dc48fb-490a-49c4-9c31-96cfbcf92dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4538f62-7aaa-455a-acce-f559c64e8a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4538f62-7aaa-455a-acce-f559c64e8a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-231300915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c01249b-e73f-4103-afd8-99e99ca8f1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978d35a8e9774959940107cbdc1fa42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:18Z,use_quota=True,user_id='c3cad5689e3544c499865481593341f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1674cb19-e068-4d42-ae9c-566616928945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1674cb19-e068-4d42-ae9c-566616928945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856857ab-3f8c-44f1-b227-bf2318328109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856857ab-3f8c-44f1-b227-bf2318328109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c01249b-e73f-4103-afd8-99e99ca8f1c2', 'volume_name': 'volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacadca8-0445-450f-a15a-440b80a03aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacadca8-0445-450f-a15a-440b80a03aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9801a377-a127-4946-87f4-a8740ed3d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:18 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Volume 5c01249b-e73f-4103-afd8-99e99ca8f1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2', 'volume_size': 1} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-231300915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c01249b-e73f-4103-afd8-99e99ca8f1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978d35a8e9774959940107cbdc1fa42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:18Z,use_quota=True,user_id='c3cad5689e3544c499865481593341f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Creating volume 5c01249b-e73f-4103-afd8-99e99ca8f1c2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:18 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:18 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 1073741824 Sep 28 16:06:18 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Created reservations ['e46dd611-3ce2-4fa0-b834-ff1c1a239ec6', '3d1f4594-9f22-4e05-bea0-8c404f2d7c0b', '7fd356d9-7228-4246-acb4-ff8e3aef675c', '72df76ac-128c-492c-9a87-873992df2580'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:19 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:06:19 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:19 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.807s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:19 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:19 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 1073741824" returned: 0 in 1.069s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Deleted volume successfully. Sep 28 16:06:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c2ff425-0997-4a85-bd6b-5de34565c803 tempest-VolumesTransfersV357Test-1574976744 None] Lock "cinder-a5b6a1e0-e073-40ae-997f-49848cb58404-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:19 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 Sep 28 16:06:19 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:20 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2" returned: 0 in 0.632s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9801a377-a127-4946-87f4-a8740ed3d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638fc70d-c602-455c-9da5-dabfe0f22930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:20 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Volume volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 (5c01249b-e73f-4103-afd8-99e99ca8f1c2): created successfully Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638fc70d-c602-455c-9da5-dabfe0f22930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Flow 'volume_create_manager' (10dc48fb-490a-49c4-9c31-96cfbcf92dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ea2d9ae1-ede5-4f4c-9f10-152106f3e505 tempest-TestMinimumBasicScenario-145411875 None] Created volume successfully. Sep 28 16:06:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4f34e7b3-69b5-4476-a04b-57d6e8a26758 req-5a2726a4-2555-4fb3-b549-d1380841fa55 tempest-TestMinimumBasicScenario-145411875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4f34e7b3-69b5-4476-a04b-57d6e8a26758 req-5a2726a4-2555-4fb3-b549-d1380841fa55 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-4f34e7b3-69b5-4476-a04b-57d6e8a26758 req-5a2726a4-2555-4fb3-b549-d1380841fa55 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-4f34e7b3-69b5-4476-a04b-57d6e8a26758 req-5a2726a4-2555-4fb3-b549-d1380841fa55 tempest-TestMinimumBasicScenario-145411875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53f33570-51c1-4cca-9b00-1d17165890d2', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:06:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-4f34e7b3-69b5-4476-a04b-57d6e8a26758 req-5a2726a4-2555-4fb3-b549-d1380841fa55 tempest-TestMinimumBasicScenario-145411875 None] attachment_update completed successfully. Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:26 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:06:26 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:27 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.597s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:06:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:06:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Flow 'volume_create_manager' (513bdc8b-321d-4574-927d-9050aaaa9fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c45247b-d2b3-464e-ab53-46730b6f9a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c45247b-d2b3-464e-ab53-46730b6f9a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-286099388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914c4a89-622c-4543-a80b-26216e35faa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5c90a31d2d46e0a4ef664ed9bb89b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:28Z,use_quota=True,user_id='aaf3135cfc284bfaa4ad32bd054b7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4b6585-a63f-408b-8f28-3e4f7890ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4b6585-a63f-408b-8f28-3e4f7890ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baba7057-0fda-4e1d-ae8f-ec9cf39961ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baba7057-0fda-4e1d-ae8f-ec9cf39961ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914c4a89-622c-4543-a80b-26216e35faa4', 'volume_name': 'volume-914c4a89-622c-4543-a80b-26216e35faa4', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660799b-4868-44a7-a5ec-d88c28681717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3660799b-4868-44a7-a5ec-d88c28681717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8111b172-de4c-4970-8386-2252b5d24b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Volume 914c4a89-622c-4543-a80b-26216e35faa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914c4a89-622c-4543-a80b-26216e35faa4', 'volume_size': 1} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-286099388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914c4a89-622c-4543-a80b-26216e35faa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5c90a31d2d46e0a4ef664ed9bb89b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:28Z,use_quota=True,user_id='aaf3135cfc284bfaa4ad32bd054b7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Creating volume 914c4a89-622c-4543-a80b-26216e35faa4 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:28 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:06:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:28 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 1073741824 Sep 28 16:06:28 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:29 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 1073741824" returned: 0 in 0.860s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:29 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 Sep 28 16:06:29 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:29 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4" returned: 0 in 0.501s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8111b172-de4c-4970-8386-2252b5d24b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914c4a89-622c-4543-a80b-26216e35faa4', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8ddeb4-c55e-4472-82fb-021d8254a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Volume volume-914c4a89-622c-4543-a80b-26216e35faa4 (914c4a89-622c-4543-a80b-26216e35faa4): created successfully Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8ddeb4-c55e-4472-82fb-021d8254a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Flow 'volume_create_manager' (513bdc8b-321d-4574-927d-9050aaaa9fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-49dda7e1-0022-4921-b5fb-e17a8b07ce19 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Created volume successfully. Sep 28 16:06:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-d718e091-3a71-4aa8-a1f9-d45456b8ab5f req-4c4ca460-4550-47b9-9bd1-9d4d39abbffd tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-d718e091-3a71-4aa8-a1f9-d45456b8ab5f req-4c4ca460-4550-47b9-9bd1-9d4d39abbffd tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-d718e091-3a71-4aa8-a1f9-d45456b8ab5f req-4c4ca460-4550-47b9-9bd1-9d4d39abbffd tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-d718e091-3a71-4aa8-a1f9-d45456b8ab5f req-4c4ca460-4550-47b9-9bd1-9d4d39abbffd tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-914c4a89-622c-4543-a80b-26216e35faa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c5db1f5-f48e-450c-9e51-6f1d22440d3b', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:06:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-d718e091-3a71-4aa8-a1f9-d45456b8ab5f req-4c4ca460-4550-47b9-9bd1-9d4d39abbffd tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] attachment_update completed successfully. Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Flow 'volume_create_manager' (235f8c17-987a-4b0d-8cbe-a9afbed16f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10aadbab-9d72-48e1-9cce-2b4c44723823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10aadbab-9d72-48e1-9cce-2b4c44723823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1723480794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07755f7-57a1-489e-ae57-f298a3a8364f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a7771aaad489cbbc8b78f13e1d617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:36Z,use_quota=True,user_id='10be81dee9fc4f3fb23ba1c8c79e4267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05585a30-de47-458a-96db-6e0fc5f2167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05585a30-de47-458a-96db-6e0fc5f2167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdd1278-df6f-4cef-b7d3-1e5501fbf67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdd1278-df6f-4cef-b7d3-1e5501fbf67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e07755f7-57a1-489e-ae57-f298a3a8364f', 'volume_name': 'volume-e07755f7-57a1-489e-ae57-f298a3a8364f', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7f1b53-1be9-41c3-8686-26eb8e3d346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7f1b53-1be9-41c3-8686-26eb8e3d346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d060b1a2-a5a9-4267-b190-0338428a855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:37 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Volume e07755f7-57a1-489e-ae57-f298a3a8364f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e07755f7-57a1-489e-ae57-f298a3a8364f', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:06:37 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Trying to clone e07755f7-57a1-489e-ae57-f298a3a8364f from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:06:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-ac8a4a22-f9b0-4a29-9919-6ef6afe2cf81 req-51fa2de4-837e-4065-8ccd-a0dfa95e1c2a tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Terminate volume connection completed successfully. Sep 28 16:06:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-ac8a4a22-f9b0-4a29-9919-6ef6afe2cf81 req-51fa2de4-837e-4065-8ccd-a0dfa95e1c2a tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Deleting attachment 9c5db1f5-f48e-450c-9e51-6f1d22440d3b. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:06:37 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:06:37 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:06:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0a8f8f-45b6-4f99-9a97-9ee73c992b92]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:38 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD Sep 28 16:06:38 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:38 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD" returned: 0 in 0.961s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:38 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 is fetched for user 10be81dee9fc4f3fb23ba1c8c79e4267. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:06:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b064561-2d59-4823-8a08-15018d27ed00]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:39 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD Sep 28 16:06:39 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Acquiring lock "cinder-914c4a89-622c-4543-a80b-26216e35faa4-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "cinder-914c4a89-622c-4543-a80b-26216e35faa4-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Acquiring lock "cinder-quobyte-914c4a89-622c-4543-a80b-26216e35faa4" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "cinder-quobyte-914c4a89-622c-4543-a80b-26216e35faa4" acquired by "delete_volume" :: waited 0.071s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:39 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1723480794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07755f7-57a1-489e-ae57-f298a3a8364f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a7771aaad489cbbc8b78f13e1d617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:36Z,use_quota=True,user_id='10be81dee9fc4f3fb23ba1c8c79e4267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Creating volume e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:39 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e199123-48a8-44d9-9c5a-13d69c132e1c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:39 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 1073741824 Sep 28 16:06:39 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:40 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 Sep 28 16:06:40 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:40 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4" returned: 0 in 0.819s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:40 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4 Sep 28 16:06:40 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:41 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 1073741824" returned: 0 in 1.263s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:41 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-914c4a89-622c-4543-a80b-26216e35faa4" returned: 0 in 0.536s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "cinder-quobyte-914c4a89-622c-4543-a80b-26216e35faa4" released by "delete_volume" :: held 1.483s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:41 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f Sep 28 16:06:41 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Created reservations ['1694a6fd-d4b3-4b95-a689-103b518cadba', '0b44aeb6-83bc-474d-aa7f-781e9208adc5', 'd714a350-b2a4-43df-a5e4-6c88c7c8c4a0', '772b825a-05c9-440c-a12a-934818c14790'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:41 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:06:41 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:41 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:41 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Attempting download of dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume e07755f7-57a1-489e-ae57-f298a3a8364f. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae09e26-6f01-4337-911c-cb358438223b]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:42 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.509s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Deleted volume successfully. Sep 28 16:06:42 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8 Sep 28 16:06:42 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79987fe3-756e-42bc-904d-9d92eeea7aa5 tempest-TestServerVolumeAttachScenarioOldVersion-762254069 None] Lock "cinder-914c4a89-622c-4543-a80b-26216e35faa4-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:42 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8" returned: 0 in 0.791s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:42 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8 Sep 28 16:06:42 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:43 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8" returned: 1 in 0.472s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_fk1s98u8' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a123567d-42a3-43cd-b52b-03d8d80a343c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:43 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD Sep 28 16:06:43 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:43 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 was qcow2, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:06:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:44 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f Sep 28 16:06:44 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:47 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f" returned: 0 in 3.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:47 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_5o2blrcadevstack@QuobyteHD, size 112.00 MB, duration 3.46 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:06:47 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Converted 112.00 MB image at 32.36 MB/s Sep 28 16:06:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:47 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 1G Sep 28 16:06:47 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:48 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 1G" returned: 0 in 1.068s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Downloaded image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume e07755f7-57a1-489e-ae57-f298a3a8364f successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 for user 10be81dee9fc4f3fb23ba1c8c79e4267 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Marking volume e07755f7-57a1-489e-ae57-f298a3a8364f as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Copying metadata from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 to e07755f7-57a1-489e-ae57-f298a3a8364f. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Creating volume glance metadata for volume e07755f7-57a1-489e-ae57-f298a3a8364f backed by image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d060b1a2-a5a9-4267-b190-0338428a855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07755f7-57a1-489e-ae57-f298a3a8364f', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098f1828-48c8-4d7c-8a5f-cfa796329b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:48 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Volume volume-e07755f7-57a1-489e-ae57-f298a3a8364f (e07755f7-57a1-489e-ae57-f298a3a8364f): created successfully Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098f1828-48c8-4d7c-8a5f-cfa796329b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Flow 'volume_create_manager' (235f8c17-987a-4b0d-8cbe-a9afbed16f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:48 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c99f1556-9566-4d56-9666-64478e200d59 tempest-VolumesExtendTest-1074948587 None] Created volume successfully. Sep 28 16:06:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d933d-2be2-4c2c-989c-6d8da5d4b848]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:50 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f Sep 28 16:06:50 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:51 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f" returned: 0 in 0.662s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 2G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f 2G" returned: 0 in 0.243s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.959s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-37517ed4-bd6f-434a-9a03-fa543bf66358 tempest-VolumesExtendTest-1074948587 None] Extend volume completed successfully. Sep 28 16:06:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-e07755f7-57a1-489e-ae57-f298a3a8364f-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-e07755f7-57a1-489e-ae57-f298a3a8364f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-quobyte-e07755f7-57a1-489e-ae57-f298a3a8364f" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:06:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-e07755f7-57a1-489e-ae57-f298a3a8364f" acquired by "delete_volume" :: waited 0.055s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:06:52 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1619ab9c-f388-444a-8a25-f61f98878576]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:52 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f Sep 28 16:06:52 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:53 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f" returned: 0 in 0.602s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:53 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f Sep 28 16:06:53 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:53 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e07755f7-57a1-489e-ae57-f298a3a8364f" returned: 0 in 0.476s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-e07755f7-57a1-489e-ae57-f298a3a8364f" released by "delete_volume" :: held 1.207s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Created reservations ['bd384722-36d4-414a-be88-4b5a3270b50a', 'b72637e9-4127-4f8d-abad-e69ec9d7744f', '66682286-1abb-4d2e-9251-e2ada73d7a3b', 'bdba94a8-21df-49b7-9ac1-6a4220877345'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:54 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:06:54 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:54 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.492s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:54 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Deleted volume successfully. Sep 28 16:06:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-08746277-0e6e-4537-a670-3474908ee995 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-e07755f7-57a1-489e-ae57-f298a3a8364f-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Flow 'volume_create_manager' (c1276a47-3de2-4887-b8c7-aaf04d013928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bf8688-a3f0-47db-a6a5-08f023db2b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bf8688-a3f0-47db-a6a5-08f023db2b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1395786925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cabd84-a65c-46f4-890b-f3591db2b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a7771aaad489cbbc8b78f13e1d617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:56Z,use_quota=True,user_id='10be81dee9fc4f3fb23ba1c8c79e4267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a26ccc1-ff73-4ec2-9994-5b565b016764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a26ccc1-ff73-4ec2-9994-5b565b016764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daa7ab6-c1b0-46ba-9de8-1ac63a8f0fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daa7ab6-c1b0-46ba-9de8-1ac63a8f0fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63cabd84-a65c-46f4-890b-f3591db2b691', 'volume_name': 'volume-63cabd84-a65c-46f4-890b-f3591db2b691', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe1481f-072c-4f28-99b9-f21604ecf405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe1481f-072c-4f28-99b9-f21604ecf405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ebebbd-5999-4c63-95e0-5bd744a8989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Volume 63cabd84-a65c-46f4-890b-f3591db2b691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63cabd84-a65c-46f4-890b-f3591db2b691', 'volume_size': 1} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1395786925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cabd84-a65c-46f4-890b-f3591db2b691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a7771aaad489cbbc8b78f13e1d617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:56Z,use_quota=True,user_id='10be81dee9fc4f3fb23ba1c8c79e4267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Creating volume 63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:56 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:06:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:56 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 1073741824 Sep 28 16:06:56 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:57 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 1073741824" returned: 0 in 1.221s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:57 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 Sep 28 16:06:57 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:58 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691" returned: 0 in 0.376s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ebebbd-5999-4c63-95e0-5bd744a8989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63cabd84-a65c-46f4-890b-f3591db2b691', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14228466-8e4d-4109-b29a-40ec94e7315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Volume volume-63cabd84-a65c-46f4-890b-f3591db2b691 (63cabd84-a65c-46f4-890b-f3591db2b691): created successfully Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14228466-8e4d-4109-b29a-40ec94e7315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Flow 'volume_create_manager' (c1276a47-3de2-4887-b8c7-aaf04d013928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-423cef53-604a-448d-bde4-e4b8f87adb3d tempest-VolumesExtendTest-1074948587 None] Created volume successfully. Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Creating offline snapshot 3b92362a-dc88-4808-aa4b-df22947873e7 of volume 63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:06:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dba368-dac6-4aeb-b135-6c2d75e8943a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:59 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 Sep 28 16:06:59 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:59 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691" returned: 0 in 0.860s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:59 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 1G Sep 28 16:06:59 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:00 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 1G" returned: 0 in 0.883s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63cabd84-a65c-46f4-890b-f3591db2b691 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:00 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63cabd84-a65c-46f4-890b-f3591db2b691 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 Sep 28 16:07:00 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:01 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63cabd84-a65c-46f4-890b-f3591db2b691 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7" returned: 0 in 0.474s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:01 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 is being set with open permissions: ugo+rw Sep 28 16:07:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:01 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 Sep 28 16:07:01 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:01 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7" returned: 0 in 0.323s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:01 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info Sep 28 16:07:01 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:02 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info" returned: 0 in 0.462s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:02 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info is being set with open permissions: ugo+rw Sep 28 16:07:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:02 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info Sep 28 16:07:02 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:02 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.info" returned: 0 in 0.411s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.679s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:02 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=58,cinder:SELECT=50,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-491f663b-27b4-4a67-be54-5a25f5c8a7ca tempest-VolumesExtendTest-1074948587 None] Create snapshot completed successfully Sep 28 16:07:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7dfa75-b3ca-4ba7-b750-28db83567824]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:03 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 Sep 28 16:07:03 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:04 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691" returned: 0 in 0.580s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 2G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 2G" returned: 0 in 0.222s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.890s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=68,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bb113409-e1e8-4ef3-8520-0e87ff1a1570 tempest-VolumesExtendTest-1074948587 None] Extend volume completed successfully. Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-3b92362a-dc88-4808-aa4b-df22947873e7-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-3b92362a-dc88-4808-aa4b-df22947873e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-quobyte-63cabd84-a65c-46f4-890b-f3591db2b691" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-63cabd84-a65c-46f4-890b-f3591db2b691" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-quobyte-3b92362a-dc88-4808-aa4b-df22947873e7" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-3b92362a-dc88-4808-aa4b-df22947873e7" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Deleting offline snapshot 3b92362a-dc88-4808-aa4b-df22947873e7 of volume 63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] snapshot_file for this snap is: volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e29ae8-8e45-4dce-911f-3b6115425c41]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:05 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 Sep 28 16:07:05 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:05 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7" returned: 0 in 0.522s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63cabd84-a65c-46f4-890b-f3591db2b691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c5220-eb80-4d33-b529-a175b3670f5e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:05 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 Sep 28 16:07:05 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:06 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691" returned: 0 in 0.777s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:06 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 Sep 28 16:07:06 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:07 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7" returned: 0 in 0.705s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:07 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7 Sep 28 16:07:07 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:07 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691.3b92362a-dc88-4808-aa4b-df22947873e7" returned: 0 in 0.434s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-3b92362a-dc88-4808-aa4b-df22947873e7" released by "_delete_snapshot" :: held 2.698s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-63cabd84-a65c-46f4-890b-f3591db2b691" released by "delete_snapshot" :: held 2.794s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Created reservations ['50f1446b-a76b-42c3-8447-72b5c63eb032', '4c8e443d-4626-4093-92fd-f15b3e9f836b', '043bfc39-81e8-4d7d-90b3-ef9dedd8d8cb', 'ce0d5c5d-1edc-4828-b055-9aaba55f630a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Delete snapshot completed successfully. Sep 28 16:07:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-74e219c0-ca38-4a8b-b1b4-354f0f8a8257 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-3b92362a-dc88-4808-aa4b-df22947873e7-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-63cabd84-a65c-46f4-890b-f3591db2b691-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-63cabd84-a65c-46f4-890b-f3591db2b691-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "cinder-quobyte-63cabd84-a65c-46f4-890b-f3591db2b691" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-63cabd84-a65c-46f4-890b-f3591db2b691" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b1172-19b6-4c58-86a6-42968a5fa733]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:08 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 Sep 28 16:07:08 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:09 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691" returned: 0 in 0.610s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:09 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691 Sep 28 16:07:09 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:09 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-63cabd84-a65c-46f4-890b-f3591db2b691" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-quobyte-63cabd84-a65c-46f4-890b-f3591db2b691" released by "delete_volume" :: held 1.189s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Created reservations ['5951ab6f-c857-424f-be65-73f2f818b9f4', '0240b461-bf70-4814-870b-2a34eb49f032', '4162fa69-7331-4a19-a2cf-6b181fdf2817', '07ca7e0c-084a-4ce2-8bec-376ea36a9055'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:09 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:07:09 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:10 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.346s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:10 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Deleted volume successfully. Sep 28 16:07:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b19ee56e-83ec-48c9-ac92-debcbd0c5d44 tempest-VolumesExtendTest-1074948587 None] Lock "cinder-63cabd84-a65c-46f4-890b-f3591db2b691-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Flow 'volume_create_manager' (f139a633-9ddd-42e0-b71d-7f8c672c5843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3402d72e-7ba8-4545-931e-56ef1dfdf8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3402d72e-7ba8-4545-931e-56ef1dfdf8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1549828561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cde681f-032f-4708-b858-b1c24c2855cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd681362d3494096113fa943fcfb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:17Z,use_quota=True,user_id='8f6286b6b5eb4512a547511a4b6ee184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa93541d-e47b-4eb5-89fb-751ae449c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa93541d-e47b-4eb5-89fb-751ae449c51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d752463-8b42-44a7-be4f-a9284dde4184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d752463-8b42-44a7-be4f-a9284dde4184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cde681f-032f-4708-b858-b1c24c2855cc', 'volume_name': 'volume-1cde681f-032f-4708-b858-b1c24c2855cc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8059f712-a374-469f-ac4a-2081c88eefc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8059f712-a374-469f-ac4a-2081c88eefc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf322df-16cf-4006-b562-16b9ae54765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:17 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Volume 1cde681f-032f-4708-b858-b1c24c2855cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cde681f-032f-4708-b858-b1c24c2855cc', 'volume_size': 1} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1549828561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cde681f-032f-4708-b858-b1c24c2855cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd681362d3494096113fa943fcfb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:17Z,use_quota=True,user_id='8f6286b6b5eb4512a547511a4b6ee184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Creating volume 1cde681f-032f-4708-b858-b1c24c2855cc {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:17 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:07:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:17 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc 1073741824 Sep 28 16:07:17 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:18 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc 1073741824" returned: 0 in 0.857s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:18 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc Sep 28 16:07:18 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:18 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc" returned: 0 in 0.365s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf322df-16cf-4006-b562-16b9ae54765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cde681f-032f-4708-b858-b1c24c2855cc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c34db-b553-430d-8b91-de88b57236e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:18 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Volume volume-1cde681f-032f-4708-b858-b1c24c2855cc (1cde681f-032f-4708-b858-b1c24c2855cc): created successfully Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c34db-b553-430d-8b91-de88b57236e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Flow 'volume_create_manager' (f139a633-9ddd-42e0-b71d-7f8c672c5843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0bfcb2b0-9bfa-4c77-aee3-6f85c02084b8 tempest-AttachVolumeNegativeTest-1745245844 None] Created volume successfully. Sep 28 16:07:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-924b4b4c-28a6-4099-adef-7f789e8f701e req-d26e3344-aaea-4111-96a4-4c4e6d7dcb3e tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-924b4b4c-28a6-4099-adef-7f789e8f701e req-d26e3344-aaea-4111-96a4-4c4e6d7dcb3e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-924b4b4c-28a6-4099-adef-7f789e8f701e req-d26e3344-aaea-4111-96a4-4c4e6d7dcb3e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:20 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-924b4b4c-28a6-4099-adef-7f789e8f701e req-d26e3344-aaea-4111-96a4-4c4e6d7dcb3e tempest-AttachVolumeNegativeTest-1745245844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-1cde681f-032f-4708-b858-b1c24c2855cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '960e9494-5e17-4023-aaf3-409f9c57e2c8', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:07:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-924b4b4c-28a6-4099-adef-7f789e8f701e req-d26e3344-aaea-4111-96a4-4c4e6d7dcb3e tempest-AttachVolumeNegativeTest-1745245844 None] attachment_update completed successfully. Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:26 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:07:26 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:27 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.373s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:07:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:07:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:07:30 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=21 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:30 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (463ffc43-0c6c-436f-9a9d-b27f3d2fb009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1054cb1a-e183-4bb3-b19a-fe5254caeed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1054cb1a-e183-4bb3-b19a-fe5254caeed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880826010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40762ba-f4bc-416c-9cb3-c7c8d617930c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:36Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282b7ef0-330b-4a0c-b874-a312629977f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282b7ef0-330b-4a0c-b874-a312629977f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4db2e2-753b-4f8e-b40a-3515bb48e36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4db2e2-753b-4f8e-b40a-3515bb48e36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40762ba-f4bc-416c-9cb3-c7c8d617930c', 'volume_name': 'volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e8c87d-965f-4a29-b37e-38aade407087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e8c87d-965f-4a29-b37e-38aade407087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743feb90-30b4-4f5f-abe5-784e34f4ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:36 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Volume b40762ba-f4bc-416c-9cb3-c7c8d617930c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c', 'volume_size': 1} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880826010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40762ba-f4bc-416c-9cb3-c7c8d617930c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:36Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Creating volume b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:36 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:07:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:36 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c 1073741824 Sep 28 16:07:36 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:37 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c 1073741824" returned: 0 in 0.656s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:37 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c Sep 28 16:07:37 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:37 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c" returned: 0 in 0.397s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743feb90-30b4-4f5f-abe5-784e34f4ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a235f26e-44db-4e06-89af-157947700a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:37 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Volume volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c (b40762ba-f4bc-416c-9cb3-c7c8d617930c): created successfully Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a235f26e-44db-4e06-89af-157947700a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:37 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (463ffc43-0c6c-436f-9a9d-b27f3d2fb009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-72bcbcc1-1727-45c3-9fd7-2a5e7daa0785 tempest-VolumesSnapshotTestJSON-610720810 None] Created volume successfully. Sep 28 16:07:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-0905db13-29cd-4fb1-9b02-d584bba26fdd req-6dcb9832-e2cc-4a7b-a5c9-0e5b1a97cad0 tempest-TestMinimumBasicScenario-145411875 None] Terminate volume connection completed successfully. Sep 28 16:07:38 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-0905db13-29cd-4fb1-9b02-d584bba26fdd req-6dcb9832-e2cc-4a7b-a5c9-0e5b1a97cad0 tempest-TestMinimumBasicScenario-145411875 None] Deleting attachment 53f33570-51c1-4cca-9b00-1d17165890d2. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Creating offline snapshot 32a1ca19-2d16-43d3-adbd-b1b883e0df0a of volume b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e2f63-77aa-4141-9511-e7a996038292]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:39 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c Sep 28 16:07:39 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Acquiring lock "cinder-5c01249b-e73f-4103-afd8-99e99ca8f1c2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Lock "cinder-5c01249b-e73f-4103-afd8-99e99ca8f1c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Acquiring lock "cinder-quobyte-5c01249b-e73f-4103-afd8-99e99ca8f1c2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Lock "cinder-quobyte-5c01249b-e73f-4103-afd8-99e99ca8f1c2" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec00e9f-3e8c-4f6a-a4c0-df8dcbfb540d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:39 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 Sep 28 16:07:39 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:39 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c" returned: 0 in 0.799s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:40 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a 1G Sep 28 16:07:40 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:40 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2" returned: 0 in 0.668s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:40 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2 Sep 28 16:07:40 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:41 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a 1G" returned: 0 in 1.027s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:41 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a Sep 28 16:07:41 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:41 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-5c01249b-e73f-4103-afd8-99e99ca8f1c2" returned: 0 in 0.743s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Lock "cinder-quobyte-5c01249b-e73f-4103-afd8-99e99ca8f1c2" released by "delete_volume" :: held 1.526s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Created reservations ['edc584ff-7d42-4c32-be26-6cdf09ded275', '38eb8e86-0c6e-45b3-8bdb-f4ba773b15d4', 'ad26b4e5-8412-4a2a-91a6-7d2c4ffc9b9a', '20d9ee7d-8232-450c-b1f0-56e501a84c3b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:41 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:07:41 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:41 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a" returned: 0 in 0.703s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:41 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a is being set with open permissions: ugo+rw Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:41 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a Sep 28 16:07:41 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:41 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.461s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:41 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:41 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Deleted volume successfully. Sep 28 16:07:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a2301cc0-ebd2-4732-b4a4-39a62b6c0581 tempest-TestMinimumBasicScenario-145411875 None] Lock "cinder-5c01249b-e73f-4103-afd8-99e99ca8f1c2-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:42 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:42 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info Sep 28 16:07:42 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:42 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info" returned: 0 in 0.621s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:42 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info is being set with open permissions: ugo+rw Sep 28 16:07:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:43 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info Sep 28 16:07:43 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:43 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.info" returned: 0 in 0.678s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d144d47b-e698-4b29-824d-10d701871b44 tempest-VolumesSnapshotTestJSON-610720810 None] Create snapshot completed successfully Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-32a1ca19-2d16-43d3-adbd-b1b883e0df0a-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-32a1ca19-2d16-43d3-adbd-b1b883e0df0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-b40762ba-f4bc-416c-9cb3-c7c8d617930c" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40762ba-f4bc-416c-9cb3-c7c8d617930c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-32a1ca19-2d16-43d3-adbd-b1b883e0df0a" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-32a1ca19-2d16-43d3-adbd-b1b883e0df0a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Deleting offline snapshot 32a1ca19-2d16-43d3-adbd-b1b883e0df0a of volume b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] snapshot_file for this snap is: volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[79028c5c-9477-4f08-967b-c21720025278]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:45 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a Sep 28 16:07:45 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:45 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a" returned: 0 in 0.598s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb87f16-4655-4c2b-ad9f-25589d1126b6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:45 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c Sep 28 16:07:45 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:46 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c" returned: 0 in 0.562s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:46 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a Sep 28 16:07:46 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:46 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a" returned: 0 in 0.509s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:46 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a Sep 28 16:07:46 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:47 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c.32a1ca19-2d16-43d3-adbd-b1b883e0df0a" returned: 0 in 0.477s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-32a1ca19-2d16-43d3-adbd-b1b883e0df0a" released by "_delete_snapshot" :: held 2.424s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40762ba-f4bc-416c-9cb3-c7c8d617930c" released by "delete_snapshot" :: held 2.468s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:47 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['ae79b268-3bce-4955-8ba1-fd6cd8c74bb5', '338bb2a6-8994-4ac5-9e4f-f68d211b3b97', '8d7cd387-8035-40d3-acf8-0bb1eb4a67b2', '4390f6af-1291-40da-9c98-a8b0e2eda811'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:47 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Delete snapshot completed successfully. Sep 28 16:07:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-83609227-7473-4aad-879c-4543a36a482e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-32a1ca19-2d16-43d3-adbd-b1b883e0df0a-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Flow 'volume_create_manager' (15f55ed0-75f2-4290-838c-f678c6dc25a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86982be0-2eb7-4a7f-91a4-36e8d55521d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86982be0-2eb7-4a7f-91a4-36e8d55521d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-664433861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27deb676-134e-4be3-9c9f-78e8a5de93bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517a29b2583d4f48805a3741e4bf9b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:49Z,use_quota=True,user_id='8ee617a5d1b641108f4222b5db1c5d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e6c67e-991d-434f-9f73-7d977cc12d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e6c67e-991d-434f-9f73-7d977cc12d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273d2c7a-117a-4ec0-9d1a-ece7e7fc02e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273d2c7a-117a-4ec0-9d1a-ece7e7fc02e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27deb676-134e-4be3-9c9f-78e8a5de93bc', 'volume_name': 'volume-27deb676-134e-4be3-9c9f-78e8a5de93bc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da70d2d-b529-48f6-9297-91740005c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da70d2d-b529-48f6-9297-91740005c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40e6c2e-6fd0-40f9-ba9c-a7a110ffb093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Volume 27deb676-134e-4be3-9c9f-78e8a5de93bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27deb676-134e-4be3-9c9f-78e8a5de93bc', 'volume_size': 1} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-664433861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27deb676-134e-4be3-9c9f-78e8a5de93bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517a29b2583d4f48805a3741e4bf9b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:49Z,use_quota=True,user_id='8ee617a5d1b641108f4222b5db1c5d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Creating volume 27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:49 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc 1073741824 Sep 28 16:07:49 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (9a06aeeb-9e7c-40db-a444-12c91c16c227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3958f25a-974b-4e9f-aba7-41a8fffd7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3958f25a-974b-4e9f-aba7-41a8fffd7f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1768667326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83ee135-0444-41d3-851c-01a1dd8fdab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:49Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f9caca-a21b-4c07-9918-5bae640dac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f9caca-a21b-4c07-9918-5bae640dac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ef9d82-7c6d-470e-afe3-c5eca339a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ef9d82-7c6d-470e-afe3-c5eca339a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83ee135-0444-41d3-851c-01a1dd8fdab8', 'volume_name': 'volume-d83ee135-0444-41d3-851c-01a1dd8fdab8', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efebe7d-15fa-4cdc-adf5-4d5e6296890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efebe7d-15fa-4cdc-adf5-4d5e6296890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf65ce9-5098-4830-a23b-8c8c4ab85291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Volume d83ee135-0444-41d3-851c-01a1dd8fdab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83ee135-0444-41d3-851c-01a1dd8fdab8', 'volume_size': 1} Sep 28 16:07:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:50 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc 1073741824" returned: 0 in 0.978s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:50 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc Sep 28 16:07:50 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:50 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc" returned: 0 in 0.364s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1768667326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83ee135-0444-41d3-851c-01a1dd8fdab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:49Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Creating volume d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:07:50 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40e6c2e-6fd0-40f9-ba9c-a7a110ffb093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27deb676-134e-4be3-9c9f-78e8a5de93bc', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0900cc97-7df8-44c6-9fca-d87e7cf055ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:50 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 1073741824 Sep 28 16:07:50 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Volume volume-27deb676-134e-4be3-9c9f-78e8a5de93bc (27deb676-134e-4be3-9c9f-78e8a5de93bc): created successfully Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0900cc97-7df8-44c6-9fca-d87e7cf055ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Flow 'volume_create_manager' (15f55ed0-75f2-4290-838c-f678c6dc25a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-293d2ae3-217f-4e46-bd0e-43af8a3cdbb0 tempest-TestImageHashVerification-1993518122 None] Created volume successfully. Sep 28 16:07:51 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 1073741824" returned: 0 in 0.817s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:51 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 Sep 28 16:07:51 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:52 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8" returned: 0 in 0.424s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf65ce9-5098-4830-a23b-8c8c4ab85291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83ee135-0444-41d3-851c-01a1dd8fdab8', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ccc148-d168-4286-bd94-c6d947d0cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:52 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Volume volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 (d83ee135-0444-41d3-851c-01a1dd8fdab8): created successfully Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ccc148-d168-4286-bd94-c6d947d0cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (9a06aeeb-9e7c-40db-a444-12c91c16c227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:52 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d2d5fba4-cb98-4efd-a21f-a5718b3b7af3 tempest-VolumesSnapshotTestJSON-610720810 None] Created volume successfully. Sep 28 16:07:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Creating offline snapshot b40554af-525a-4163-867c-5f0d6aa08093 of volume d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:07:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5858869-ac48-4cf6-8ec2-a5af868e8fc6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:53 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 Sep 28 16:07:53 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:54 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8" returned: 0 in 0.774s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:54 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 1G Sep 28 16:07:54 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:55 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 1G" returned: 0 in 0.658s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:55 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 Sep 28 16:07:55 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:55 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093" returned: 0 in 0.411s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:55 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 is being set with open permissions: ugo+rw Sep 28 16:07:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:55 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 Sep 28 16:07:55 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:56 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093" returned: 0 in 0.578s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:56 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info Sep 28 16:07:56 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:56 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:56 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info is being set with open permissions: ugo+rw Sep 28 16:07:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:56 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info Sep 28 16:07:56 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:57 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.info" returned: 0 in 0.394s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.117s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e44387b8-6c2a-46d6-b9d0-3e1e0daa2a42 tempest-VolumesSnapshotTestJSON-610720810 None] Create snapshot completed successfully Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac40ea13-4699-406c-bbd9-6efa53a250cb]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:57 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc Sep 28 16:07:57 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:57 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc" returned: 0 in 0.708s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e6d69-fb27-4585-8ced-830ec06ee29f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:58 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc Sep 28 16:07:58 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:58 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc" returned: 0 in 0.876s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc /opt/stack/data/cinder/conversion/27deb676-134e-4be3-9c9f-78e8a5de93bc.temp_image.8e79c28d-18fa-4d99-87d2-f0799e006039ahy71pj1.img {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:58 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc /opt/stack/data/cinder/conversion/27deb676-134e-4be3-9c9f-78e8a5de93bc.temp_image.8e79c28d-18fa-4d99-87d2-f0799e006039ahy71pj1.img Sep 28 16:07:58 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:58 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (a8fff7d6-d835-49b1-acfa-a16b5acd34f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17f2b9a-d632-4a46-ba63-e1928e080c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17f2b9a-d632-4a46-ba63-e1928e080c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2146064284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7120fd0-e0b8-464f-a948-d920f9c2917b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:07:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b40554af-525a-4163-867c-5f0d6aa08093,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:07:59Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5959480e-d390-4e04-9010-e6eb75bc8da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5959480e-d390-4e04-9010-e6eb75bc8da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f940187-731d-46d4-825f-a6eb5257ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f940187-731d-46d4-825f-a6eb5257ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7120fd0-e0b8-464f-a948-d920f9c2917b', 'volume_name': 'volume-d7120fd0-e0b8-464f-a948-d920f9c2917b', 'volume_size': 2, 'snapshot_id': 'b40554af-525a-4163-867c-5f0d6aa08093'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd8d00b-da80-4f97-97bd-7efbb00358e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd8d00b-da80-4f97-97bd-7efbb00358e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f608e1a6-e366-4004-9156-8887b28f1fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:07:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Volume d7120fd0-e0b8-464f-a948-d920f9c2917b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7120fd0-e0b8-464f-a948-d920f9c2917b', 'volume_size': 2, 'snapshot_id': 'b40554af-525a-4163-867c-5f0d6aa08093'} Sep 28 16:07:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:09 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=35,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:09 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=27,cinder:SELECT=31,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:10 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc /opt/stack/data/cinder/conversion/27deb676-134e-4be3-9c9f-78e8a5de93bc.temp_image.8e79c28d-18fa-4d99-87d2-f0799e006039ahy71pj1.img" returned: 0 in 11.802s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdbbd0b-f516-433a-b7e4-931f3b003b64]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:10 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc Sep 28 16:08:10 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:11 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc" returned: 0 in 0.703s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:11 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc, size 1024.00 MB, duration 11.81 sec, destination /opt/stack/data/cinder/conversion/27deb676-134e-4be3-9c9f-78e8a5de93bc.temp_image.8e79c28d-18fa-4d99-87d2-f0799e006039ahy71pj1.img {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:08:11 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Converted 1024.00 MB image at 86.72 MB/s Sep 28 16:08:11 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] 8e79c28d-18fa-4d99-87d2-f0799e006039 was raw, no need to convert to raw {{(pid=86628) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 16:08:21 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:21 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:26 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:08:26 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:27 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Flow 'volume_create_manager' (64e36dac-edd5-494d-99c2-4c8230a2a263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5e1f99-1854-4485-be9b-4d9fb2be67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.566s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5e1f99-1854-4485-be9b-4d9fb2be67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1443549b-747c-4c7b-89b6-1d47d8d508a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e897a9ddf634b4bad1221b7200f2b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:27Z,use_quota=True,user_id='f9c1522d042840bab2b15dc2d89a3c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6a6689-9d97-4cdd-9ad1-26e38ed3e175),volume_type_id=ca6a6689-9d97-4cdd-9ad1-26e38ed3e175)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dc193e-521b-4924-9ba1-277eb49f2467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dc193e-521b-4924-9ba1-277eb49f2467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bf6e82-3975-462b-9f20-54b5c60a20e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bf6e82-3975-462b-9f20-54b5c60a20e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1443549b-747c-4c7b-89b6-1d47d8d508a7', 'volume_name': 'volume-1443549b-747c-4c7b-89b6-1d47d8d508a7', 'volume_size': 1, 'image_id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1747358a-e3cd-434d-8a08-eb79af06dd06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3b440597ee69a994693c938c0b9e2f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e897a9ddf634b4bad1221b7200f2b49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba1986969d289cbe9daee4b42e7f80cba0af87541d6908a3e6fb2431ede4b7703e5190c3e300b9ed19b2531701ea5159cde4c80dd9a28c9b436189b36f32b42', 'id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'created_at': datetime.datetime(2026, 9, 28, 14, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 8, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1747358a-e3cd-434d-8a08-eb79af06dd06/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa7dcc-3870-458d-b561-c4fb86efbc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa7dcc-3870-458d-b561-c4fb86efbc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1309a738-fab2-4ebd-84e1-9db139bd7170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:27 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Volume 1443549b-747c-4c7b-89b6-1d47d8d508a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1443549b-747c-4c7b-89b6-1d47d8d508a7', 'volume_size': 1, 'image_id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1747358a-e3cd-434d-8a08-eb79af06dd06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3b440597ee69a994693c938c0b9e2f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e897a9ddf634b4bad1221b7200f2b49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba1986969d289cbe9daee4b42e7f80cba0af87541d6908a3e6fb2431ede4b7703e5190c3e300b9ed19b2531701ea5159cde4c80dd9a28c9b436189b36f32b42', 'id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'created_at': datetime.datetime(2026, 9, 28, 14, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 8, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1747358a-e3cd-434d-8a08-eb79af06dd06/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Trying to clone 1443549b-747c-4c7b-89b6-1d47d8d508a7 from image 1747358a-e3cd-434d-8a08-eb79af06dd06 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1747358a-e3cd-434d-8a08-eb79af06dd06', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:08:27 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d5bf6c-cfbc-4831-9ec2-256a9c785e55]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:28 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD Sep 28 16:08:28 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:28 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD" returned: 0 in 0.633s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:28 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD Sep 28 16:08:28 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:29 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD" returned: 1 in 0.550s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Temporary image 1747358a-e3cd-434d-8a08-eb79af06dd06 is fetched for user f9c1522d042840bab2b15dc2d89a3c92. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdf3d72-9b62-41b0-98c7-fdd5236f78b7]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:29 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD Sep 28 16:08:29 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-9ea1f84c-e352-44be-9af5-d51a65c2bfcc req-17b46a8b-86e4-45fe-a6f2-ccb2dcaa6d76 tempest-AttachVolumeNegativeTest-1745245844 None] Terminate volume connection completed successfully. Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-9ea1f84c-e352-44be-9af5-d51a65c2bfcc req-17b46a8b-86e4-45fe-a6f2-ccb2dcaa6d76 tempest-AttachVolumeNegativeTest-1745245844 None] Deleting attachment 960e9494-5e17-4023-aaf3-409f9c57e2c8. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:08:29 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:30 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD Sep 28 16:08:30 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:30 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD" returned: 1 in 0.641s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:08:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.112s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Uploaded volume to glance image-id: 8e79c28d-18fa-4d99-87d2-f0799e006039. {{(pid=86628) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 39.040s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-b40554af-525a-4163-867c-5f0d6aa08093-d7120fd0-e0b8-464f-a948-d920f9c2917b" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40554af-525a-4163-867c-5f0d6aa08093-d7120fd0-e0b8-464f-a948-d920f9c2917b" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Creating volume d7120fd0-e0b8-464f-a948-d920f9c2917b from snapshot b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-d7120fd0-e0b8-464f-a948-d920f9c2917b" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-98c439e0-c455-4d27-99ec-94266d91f6d9 tempest-TestImageHashVerification-1993518122 None] Copy volume to image completed successfully. Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d7120fd0-e0b8-464f-a948-d920f9c2917b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] snapshot: b40554af-525a-4163-867c-5f0d6aa08093, volume: d7120fd0-e0b8-464f-a948-d920f9c2917b, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1de914c-2928-4fbe-bdef-9ff56ba1f7ba]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:38 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 Sep 28 16:08:38 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:38 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093" returned: 0 in 0.502s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d83ee135-0444-41d3-851c-01a1dd8fdab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1cad3c-382b-4f0b-9ed7-2de0665ed6f5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:38 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 Sep 28 16:08:38 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Acquiring lock "cinder-27deb676-134e-4be3-9c9f-78e8a5de93bc-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Lock "cinder-27deb676-134e-4be3-9c9f-78e8a5de93bc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:39 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8" returned: 0 in 0.572s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Acquiring lock "cinder-quobyte-27deb676-134e-4be3-9c9f-78e8a5de93bc" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:39 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b Sep 28 16:08:39 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Lock "cinder-quobyte-27deb676-134e-4be3-9c9f-78e8a5de93bc" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd9df3d-452b-43b3-bcf5-dc1d25ddb259]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:39 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc Sep 28 16:08:39 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:39 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc" returned: 0 in 0.498s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:40 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc Sep 28 16:08:40 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:40 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-27deb676-134e-4be3-9c9f-78e8a5de93bc" returned: 0 in 0.627s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Lock "cinder-quobyte-27deb676-134e-4be3-9c9f-78e8a5de93bc" released by "delete_volume" :: held 1.190s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:40 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Created reservations ['50465a90-605b-4103-a767-05324f5aedff', '45ac7b6f-c198-4a3c-ade1-d0fc2c3f5611', '352a82ca-104e-48e3-8bbd-7d0227c6fcca', 'fbbb6b0a-0bf1-4483-a398-4dc477ac0ec8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:41 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:08:41 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:41 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.694s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:41 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Deleted volume successfully. Sep 28 16:08:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2a3fa711-486f-4a4e-a8ff-b8b49287bc27 tempest-TestImageHashVerification-1993518122 None] Lock "cinder-27deb676-134e-4be3-9c9f-78e8a5de93bc-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:49 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b" returned: 0 in 9.897s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:08:49 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Converted 1024.00 MB image at 103.45 MB/s Sep 28 16:08:49 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b is being set with open permissions: ugo+rw Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:49 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b Sep 28 16:08:49 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:49 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b" returned: 0 in 0.335s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d7120fd0-e0b8-464f-a948-d920f9c2917b" released by "_copy_volume_from_snapshot" :: held 11.423s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40554af-525a-4163-867c-5f0d6aa08093-d7120fd0-e0b8-464f-a948-d920f9c2917b" released by "_create_volume_from_snapshot" :: held 11.511s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.543s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.119s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1443549b-747c-4c7b-89b6-1d47d8d508a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e897a9ddf634b4bad1221b7200f2b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:27Z,use_quota=True,user_id='f9c1522d042840bab2b15dc2d89a3c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6a6689-9d97-4cdd-9ad1-26e38ed3e175),volume_type_id=ca6a6689-9d97-4cdd-9ad1-26e38ed3e175)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Creating volume 1443549b-747c-4c7b-89b6-1d47d8d508a7 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:08:49 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:49 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 1073741824 Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f608e1a6-e366-4004-9156-8887b28f1fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7120fd0-e0b8-464f-a948-d920f9c2917b', 'volume_size': 2, 'snapshot_id': 'b40554af-525a-4163-867c-5f0d6aa08093'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac0068b-77ca-4892-9650-6ccf55dbc69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:49 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Volume volume-d7120fd0-e0b8-464f-a948-d920f9c2917b (d7120fd0-e0b8-464f-a948-d920f9c2917b): created successfully Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac0068b-77ca-4892-9650-6ccf55dbc69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (a8fff7d6-d835-49b1-acfa-a16b5acd34f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a6fbfd4d-ad0f-4b84-8f6b-dcc586a15ecb tempest-VolumesSnapshotTestJSON-610720810 None] Created volume successfully. Sep 28 16:08:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-d7120fd0-e0b8-464f-a948-d920f9c2917b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-d7120fd0-e0b8-464f-a948-d920f9c2917b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-d7120fd0-e0b8-464f-a948-d920f9c2917b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:50 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d7120fd0-e0b8-464f-a948-d920f9c2917b" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 1073741824" returned: 0 in 1.205s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d78dfec-c1e1-4a0e-a392-43e3e1c31392]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:51 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 Sep 28 16:08:51 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:51 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b Sep 28 16:08:51 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:51 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7" returned: 0 in 0.452s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Attempting download of 1747358a-e3cd-434d-8a08-eb79af06dd06 ((None, [{'url': 'file:///opt/stack/data/glance/images/1747358a-e3cd-434d-8a08-eb79af06dd06', 'metadata': {}}])) to volume 1443549b-747c-4c7b-89b6-1d47d8d508a7. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc18b9-0e99-49db-9048-d00fe8556a08]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:51 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b" returned: 0 in 0.815s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:51 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b Sep 28 16:08:51 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:52 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9 Sep 28 16:08:52 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:52 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d7120fd0-e0b8-464f-a948-d920f9c2917b" returned: 0 in 0.400s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d7120fd0-e0b8-464f-a948-d920f9c2917b" released by "delete_volume" :: held 1.349s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:52 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9" returned: 0 in 0.593s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['23a7c16c-f9ea-497e-bb13-4d691b2b08f0', '3e64ca91-4dfe-44c1-94da-9fca5d06e275', '5089f3c2-b7ba-4caf-8867-9c1b3d38508c', 'bdf62697-2ab5-405d-8c60-da0ad354fd7e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:52 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9 Sep 28 16:08:52 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:52 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:08:52 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:53 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9" returned: 1 in 0.726s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1747358a-e3cd-434d-8a08-eb79af06dd06_yxo2b2g9' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c8328a-71f9-4d58-80bb-c2156da14a6e]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:53 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.480s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Deleted volume successfully. Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27f6be74-2658-4bdf-963a-6c6e07591b93 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-d7120fd0-e0b8-464f-a948-d920f9c2917b-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-b40554af-525a-4163-867c-5f0d6aa08093-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:53 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD Sep 28 16:08:53 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-b40554af-525a-4163-867c-5f0d6aa08093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-d83ee135-0444-41d3-851c-01a1dd8fdab8" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d83ee135-0444-41d3-851c-01a1dd8fdab8" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-b40554af-525a-4163-867c-5f0d6aa08093" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40554af-525a-4163-867c-5f0d6aa08093" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Deleting offline snapshot b40554af-525a-4163-867c-5f0d6aa08093 of volume d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] snapshot_file for this snap is: volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ef6bd-93b4-4321-b39a-61b7703c972a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:53 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 Sep 28 16:08:53 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:53 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:54 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD Sep 28 16:08:54 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:54 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093" returned: 0 in 0.740s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d83ee135-0444-41d3-851c-01a1dd8fdab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a07d978-67fb-40de-9651-ac092027e888]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:54 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD" returned: 1 in 0.581s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] 1747358a-e3cd-434d-8a08-eb79af06dd06 was raw, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:08:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:54 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 Sep 28 16:08:54 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:54 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 Sep 28 16:08:54 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:55 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7" returned: 0 in 1.204s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:55 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1747358a-e3cd-434d-8a08-eb79af06dd06_v1vmlkdpdevstack@QuobyteHD, size 0.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:08:55 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:08:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:55 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8" returned: 0 in 1.370s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:55 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 1G Sep 28 16:08:55 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:55 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 Sep 28 16:08:55 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:56 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093" returned: 0 in 0.826s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:56 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093 Sep 28 16:08:56 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:56 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 1G" returned: 0 in 1.030s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Downloaded image 1747358a-e3cd-434d-8a08-eb79af06dd06 ((None, [{'url': 'file:///opt/stack/data/glance/images/1747358a-e3cd-434d-8a08-eb79af06dd06', 'metadata': {}}])) to volume 1443549b-747c-4c7b-89b6-1d47d8d508a7 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Temporary image 1747358a-e3cd-434d-8a08-eb79af06dd06 for user f9c1522d042840bab2b15dc2d89a3c92 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Marking volume 1443549b-747c-4c7b-89b6-1d47d8d508a7 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Copying metadata from image 1747358a-e3cd-434d-8a08-eb79af06dd06 to 1443549b-747c-4c7b-89b6-1d47d8d508a7. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:08:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Creating volume glance metadata for volume 1443549b-747c-4c7b-89b6-1d47d8d508a7 backed by image 1747358a-e3cd-434d-8a08-eb79af06dd06 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c3b440597ee69a994693c938c0b9e2f9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1309a738-fab2-4ebd-84e1-9db139bd7170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1443549b-747c-4c7b-89b6-1d47d8d508a7', 'volume_size': 1, 'image_id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1747358a-e3cd-434d-8a08-eb79af06dd06', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3b440597ee69a994693c938c0b9e2f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e897a9ddf634b4bad1221b7200f2b49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba1986969d289cbe9daee4b42e7f80cba0af87541d6908a3e6fb2431ede4b7703e5190c3e300b9ed19b2531701ea5159cde4c80dd9a28c9b436189b36f32b42', 'id': '1747358a-e3cd-434d-8a08-eb79af06dd06', 'created_at': datetime.datetime(2026, 9, 28, 14, 8, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 8, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1747358a-e3cd-434d-8a08-eb79af06dd06/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:57 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f34cd55-4ead-4fd6-93cc-42e71c47ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8.b40554af-525a-4163-867c-5f0d6aa08093" returned: 0 in 0.545s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Volume volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 (1443549b-747c-4c7b-89b6-1d47d8d508a7): created successfully Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f34cd55-4ead-4fd6-93cc-42e71c47ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Flow 'volume_create_manager' (64e36dac-edd5-494d-99c2-4c8230a2a263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4883970a-7703-45ae-b74c-077a32f67367 tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Created volume successfully. Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40554af-525a-4163-867c-5f0d6aa08093" released by "_delete_snapshot" :: held 3.796s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d83ee135-0444-41d3-851c-01a1dd8fdab8" released by "delete_snapshot" :: held 3.850s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['c1255d8a-0716-4810-a86d-74df9e574eed', '7375a8e6-78fb-424d-b74b-bb731b857548', '83dbcb16-07e1-4105-9fdc-f187beff33f9', 'b17721d4-b8fc-45da-a2f2-37788c28c0cc'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Delete snapshot completed successfully. Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b26f2546-64f6-4ffc-bb30-01366dcdaaf7 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-b40554af-525a-4163-867c-5f0d6aa08093-delete_snapshot" released by "delete_snapshot" :: held 4.160s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Acquiring lock "cinder-1443549b-747c-4c7b-89b6-1d47d8d508a7-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "cinder-1443549b-747c-4c7b-89b6-1d47d8d508a7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Acquiring lock "cinder-quobyte-1443549b-747c-4c7b-89b6-1d47d8d508a7" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "cinder-quobyte-1443549b-747c-4c7b-89b6-1d47d8d508a7" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[731ca6d2-48b3-492c-b17b-8c62e9ab9861]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-d83ee135-0444-41d3-851c-01a1dd8fdab8-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-d83ee135-0444-41d3-851c-01a1dd8fdab8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-d83ee135-0444-41d3-851c-01a1dd8fdab8" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d83ee135-0444-41d3-851c-01a1dd8fdab8" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:58 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 Sep 28 16:08:58 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[769182f7-2e7c-4390-9bdd-d0fb4fca21c4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:58 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 Sep 28 16:08:58 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:58 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7" returned: 0 in 0.756s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:59 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7 Sep 28 16:08:59 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:59 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8" returned: 0 in 0.580s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:59 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8 Sep 28 16:08:59 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:59 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1443549b-747c-4c7b-89b6-1d47d8d508a7" returned: 0 in 0.568s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "cinder-quobyte-1443549b-747c-4c7b-89b6-1d47d8d508a7" released by "delete_volume" :: held 1.460s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:59 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:59 devstack cinder-volume[86628]: WARNING cinder.quota [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:08:59 devstack cinder-volume[86628]: WARNING cinder.quota [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d83ee135-0444-41d3-851c-01a1dd8fdab8" returned: 0 in 0.463s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-d83ee135-0444-41d3-851c-01a1dd8fdab8" released by "delete_volume" :: held 1.193s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Created reservations ['7ab1ed17-4d6a-4005-a5bd-c9a491785b51', '2a6a8bdf-a3ed-4358-809c-d8f2a8ecf152', '9d9dbb58-7031-413b-a624-7c7f1adba1bc', '3b3cc639-e2ac-424c-8a1c-eb0a32dc9885'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['3b01caeb-297b-4f3a-85e3-d340b3db122e', 'd71bcece-061b-47c5-80c1-13e435b84ae6', '84c97bf2-b78e-4df7-8b5e-6ad63e2af928', '98d7023c-306d-4d2f-8cb5-14a5ac6e28a5'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:59 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:08:59 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:00 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:00 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:00 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.363s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:00 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:00 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Deleted volume successfully. Sep 28 16:09:00 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.333s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:00 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-233c13ab-3fd5-4ef8-975c-e278eaadc2ee tempest-VolumeAndVolumeTypeFromImageTest-730871249 None] Lock "cinder-1443549b-747c-4c7b-89b6-1d47d8d508a7-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:00 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Deleted volume successfully. Sep 28 16:09:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-38fe1bc7-cece-4f23-9896-2483f5063f68 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-d83ee135-0444-41d3-851c-01a1dd8fdab8-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (11c03033-4bcd-4de6-8d1c-23a56c298e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc52ace-8669-4030-8792-7c74c1e6b0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc52ace-8669-4030-8792-7c74c1e6b0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1831770459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770e5158-abe8-45d4-92d4-d8e39aa385e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:02Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d20deb-39f6-4e3d-b189-91bb546b3651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d20deb-39f6-4e3d-b189-91bb546b3651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf6fe9d-6d70-4d2c-8cfd-524a215cf4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf6fe9d-6d70-4d2c-8cfd-524a215cf4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770e5158-abe8-45d4-92d4-d8e39aa385e2', 'volume_name': 'volume-770e5158-abe8-45d4-92d4-d8e39aa385e2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56f96b-838c-4fe8-9f01-91de92d2ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd56f96b-838c-4fe8-9f01-91de92d2ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ccd77-52ce-450e-8565-0fd4f0b9f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Volume 770e5158-abe8-45d4-92d4-d8e39aa385e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770e5158-abe8-45d4-92d4-d8e39aa385e2', 'volume_size': 1} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1831770459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770e5158-abe8-45d4-92d4-d8e39aa385e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:02Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Creating volume 770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:01 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:01 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 1073741824 Sep 28 16:09:01 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:02 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 1073741824" returned: 0 in 0.599s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:02 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 Sep 28 16:09:02 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:03 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2" returned: 0 in 0.627s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ccd77-52ce-450e-8565-0fd4f0b9f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770e5158-abe8-45d4-92d4-d8e39aa385e2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b073390-7775-4040-a4a4-1192c9500494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Volume volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 (770e5158-abe8-45d4-92d4-d8e39aa385e2): created successfully Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b073390-7775-4040-a4a4-1192c9500494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (11c03033-4bcd-4de6-8d1c-23a56c298e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:03 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0cad4924-05c8-4b30-b97d-eb6b5ea2a97e tempest-VolumesSnapshotTestJSON-610720810 None] Created volume successfully. Sep 28 16:09:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Creating offline snapshot c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 of volume 770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e139f8-86bd-4482-ad5e-d6f87ac5527e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:04 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 Sep 28 16:09:04 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:05 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2" returned: 0 in 0.827s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:05 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 1G Sep 28 16:09:05 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:06 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 1G" returned: 0 in 0.721s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:06 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 Sep 28 16:09:06 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:06 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" returned: 0 in 0.584s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:06 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 is being set with open permissions: ugo+rw Sep 28 16:09:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:06 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 Sep 28 16:09:06 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" returned: 0 in 0.376s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:07 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info Sep 28 16:09:07 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info" returned: 0 in 0.442s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:07 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info is being set with open permissions: ugo+rw Sep 28 16:09:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:07 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info Sep 28 16:09:07 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.info" returned: 0 in 0.376s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.529s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-17884052-6c5b-4c9d-a017-3c88002dc080 tempest-VolumesSnapshotTestJSON-610720810 None] Create snapshot completed successfully Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (2f856a71-fc85-41d6-993a-df1cc0dd0676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06388299-b479-449f-83cf-b9da0b429671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06388299-b479-449f-83cf-b9da0b429671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1112907127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6508d92b-9892-4616-b878-18c06ff4a0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:09Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470c1d0-a004-40b6-a132-b2b49d3a343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c470c1d0-a004-40b6-a132-b2b49d3a343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d802377-b382-434d-80f4-4b99f1d2cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d802377-b382-434d-80f4-4b99f1d2cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6508d92b-9892-4616-b878-18c06ff4a0b7', 'volume_name': 'volume-6508d92b-9892-4616-b878-18c06ff4a0b7', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea757b92-6632-4953-8e78-38f002dce4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea757b92-6632-4953-8e78-38f002dce4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9aff3b-4fb1-4920-a39f-9d3fa701ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Volume 6508d92b-9892-4616-b878-18c06ff4a0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6508d92b-9892-4616-b878-18c06ff4a0b7', 'volume_size': 1} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1112907127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6508d92b-9892-4616-b878-18c06ff4a0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:09Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Creating volume 6508d92b-9892-4616-b878-18c06ff4a0b7 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:09 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:09 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 1073741824 Sep 28 16:09:09 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (4d2a7b4d-7ebc-4dc3-8346-949f124bfa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933e0dfe-efc5-4012-8eb3-06599b6f86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933e0dfe-efc5-4012-8eb3-06599b6f86d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1504348893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c085446f-85a4-430b-902f-e86c6f82305a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0efb3e948d48e6afdd851e1d58a8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:10Z,use_quota=True,user_id='ade945e2e64e44b9b3459d092343bdc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c468b36-3533-4d71-a572-b69c9558d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c468b36-3533-4d71-a572-b69c9558d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a3ac51-ff77-4361-bbf2-ea85ae7e7d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a3ac51-ff77-4361-bbf2-ea85ae7e7d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c085446f-85a4-430b-902f-e86c6f82305a', 'volume_name': 'volume-c085446f-85a4-430b-902f-e86c6f82305a', 'volume_size': 1, 'snapshot_id': 'c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f466579-9f57-40d8-8c65-97965870795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f466579-9f57-40d8-8c65-97965870795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5172485-e198-4780-8987-808785827683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:09 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Volume c085446f-85a4-430b-902f-e86c6f82305a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c085446f-85a4-430b-902f-e86c6f82305a', 'volume_size': 1, 'snapshot_id': 'c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16'} Sep 28 16:09:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (69acb78e-f871-437e-ab54-3a4e1b6d0da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72754995-df0f-44e4-b291-61caa5fdcb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72754995-df0f-44e4-b291-61caa5fdcb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305593080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:10Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a3b2ea-0086-4af9-ad15-91239e544df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a3b2ea-0086-4af9-ad15-91239e544df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b59924-98d9-4811-b88f-73db91708911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b59924-98d9-4811-b88f-73db91708911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5', 'volume_name': 'volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce3da71-3fb0-4479-9992-82d229841796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce3da71-3fb0-4479-9992-82d229841796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5195b49-4625-4f01-908b-f7bfad4dfa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Volume c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5', 'volume_size': 1} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 1073741824" returned: 0 in 0.928s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:10 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 Sep 28 16:09:10 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (eab2335d-8f0e-4451-8f88-fa331eeff7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccb9383-4a72-4ef7-a5b4-fc3e8b39a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccb9383-4a72-4ef7-a5b4-fc3e8b39a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-213611605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874851cc-a8b3-4f99-8f28-75497938f7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:11Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e04e00-410b-4174-8a52-46bd4ea11ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e04e00-410b-4174-8a52-46bd4ea11ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7feb921-a011-40b4-99a2-410d98ffe770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7feb921-a011-40b4-99a2-410d98ffe770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874851cc-a8b3-4f99-8f28-75497938f7a9', 'volume_name': 'volume-874851cc-a8b3-4f99-8f28-75497938f7a9', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45864a2-282f-4e71-9866-d71c17ce776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45864a2-282f-4e71-9866-d71c17ce776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd20a74-ff68-4045-a6f8-3fe89701fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Volume 874851cc-a8b3-4f99-8f28-75497938f7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874851cc-a8b3-4f99-8f28-75497938f7a9', 'volume_size': 1} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7" returned: 0 in 0.537s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.914s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16-c085446f-85a4-430b-902f-e86c6f82305a" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9aff3b-4fb1-4920-a39f-9d3fa701ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6508d92b-9892-4616-b878-18c06ff4a0b7', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da82058-4d19-4480-887b-fb1650d2a077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16-c085446f-85a4-430b-902f-e86c6f82305a" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Creating volume c085446f-85a4-430b-902f-e86c6f82305a from snapshot c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-c085446f-85a4-430b-902f-e86c6f82305a" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Volume volume-6508d92b-9892-4616-b878-18c06ff4a0b7 (6508d92b-9892-4616-b878-18c06ff4a0b7): created successfully Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da82058-4d19-4480-887b-fb1650d2a077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (2f856a71-fc85-41d6-993a-df1cc0dd0676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c085446f-85a4-430b-902f-e86c6f82305a" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] snapshot: c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16, volume: c085446f-85a4-430b-902f-e86c6f82305a, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:09:11 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-09654dd0-813b-47c1-a080-c04c73d4e4e9 tempest-CreateVolumesFromImageTest-1907235240 None] Created volume successfully. Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916f870-f3d0-44fe-86b5-30c3dbac7f3c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (f15ef2f4-15b9-4270-8807-fa851034c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e879d6a-999e-4d6c-a0e0-213de1d3163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e879d6a-999e-4d6c-a0e0-213de1d3163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270079956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55f4bba-c32e-4286-80be-ad7e6c87a638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:11Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846b529e-cbfb-43c2-80ea-7000a1f7f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846b529e-cbfb-43c2-80ea-7000a1f7f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 Sep 28 16:09:11 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df62cb4-58b7-4008-b8af-83850df2047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df62cb4-58b7-4008-b8af-83850df2047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55f4bba-c32e-4286-80be-ad7e6c87a638', 'volume_name': 'volume-f55f4bba-c32e-4286-80be-ad7e6c87a638', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92704cec-3f67-43db-9ea7-18d874f3de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92704cec-3f67-43db-9ea7-18d874f3de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97646f9-f768-4fe4-b6b4-83bee35c759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Volume f55f4bba-c32e-4286-80be-ad7e6c87a638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55f4bba-c32e-4286-80be-ad7e6c87a638', 'volume_size': 1} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (c5486fd9-ff46-461b-ba81-2e7d421225d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa879475-170c-4c0c-b6fb-3bf893ed0f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa879475-170c-4c0c-b6fb-3bf893ed0f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714696007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0118912-5e05-4ead-8cf5-3b4e32d9404b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:12Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f42e650-3bdb-4679-b709-c7f936eb6f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f42e650-3bdb-4679-b709-c7f936eb6f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247ddbfe-2794-4f0a-8b37-81d75c56d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247ddbfe-2794-4f0a-8b37-81d75c56d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0118912-5e05-4ead-8cf5-3b4e32d9404b', 'volume_name': 'volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed283645-1ba3-4af3-955c-1e1210946a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed283645-1ba3-4af3-955c-1e1210946a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dcd104-e092-4b9f-8bb0-185f922a9d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Volume d0118912-5e05-4ead-8cf5-3b4e32d9404b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b', 'volume_size': 1} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" returned: 0 in 0.754s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770e5158-abe8-45d4-92d4-d8e39aa385e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d26669-65e6-4ea4-89f9-9d3623cbdd94]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:12 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 Sep 28 16:09:12 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:12 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2" returned: 0 in 0.476s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:09:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:09:12 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:09:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:12 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a Sep 28 16:09:12 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Flow 'volume_create_manager' (10860b27-cf5f-4a86-be69-ab3689a798d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f482d2-e356-4173-8e9e-d27740095d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f482d2-e356-4173-8e9e-d27740095d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1488775453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd681362d3494096113fa943fcfb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:21Z,use_quota=True,user_id='8f6286b6b5eb4512a547511a4b6ee184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be310a-e13b-4e29-a56e-bbb918bfe1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be310a-e13b-4e29-a56e-bbb918bfe1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052070f3-8daf-4b09-b3b9-6c033b55985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052070f3-8daf-4b09-b3b9-6c033b55985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e', 'volume_name': 'volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90ac8ef-c854-4cf8-8a37-fc565df38e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90ac8ef-c854-4cf8-8a37-fc565df38e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc85a06-5b73-488b-aed8-574334927be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:21 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Volume fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e', 'volume_size': 1} Sep 28 16:09:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:22 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a" returned: 0 in 10.328s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:22 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2, size 1024.00 MB, duration 10.33 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:09:22 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Converted 1024.00 MB image at 99.12 MB/s Sep 28 16:09:22 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a is being set with open permissions: ugo+rw Sep 28 16:09:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:22 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a Sep 28 16:09:22 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a" returned: 0 in 0.293s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c085446f-85a4-430b-902f-e86c6f82305a" released by "_copy_volume_from_snapshot" :: held 12.026s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=64,cinder:SELECT=44,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=60,cinder:INSERT=14,cinder:UPDATE=48,cinder:DELETE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16-c085446f-85a4-430b-902f-e86c6f82305a" released by "_create_volume_from_snapshot" :: held 12.156s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.201s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.922s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305593080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:10Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Creating volume c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:23 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 1073741824 Sep 28 16:09:23 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5172485-e198-4780-8987-808785827683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c085446f-85a4-430b-902f-e86c6f82305a', 'volume_size': 1, 'snapshot_id': 'c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21671bdc-065e-433e-8a02-d547776406e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:23 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Volume volume-c085446f-85a4-430b-902f-e86c6f82305a (c085446f-85a4-430b-902f-e86c6f82305a): created successfully Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21671bdc-065e-433e-8a02-d547776406e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Flow 'volume_create_manager' (4d2a7b4d-7ebc-4dc3-8346-949f124bfa5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-67239520-9478-4eca-bdd5-b51e58aa0a66 tempest-VolumesSnapshotTestJSON-610720810 None] Created volume successfully. Sep 28 16:09:23 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 1073741824" returned: 0 in 0.572s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-c085446f-85a4-430b-902f-e86c6f82305a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-c085446f-85a4-430b-902f-e86c6f82305a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-c085446f-85a4-430b-902f-e86c6f82305a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:23 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 Sep 28 16:09:23 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c085446f-85a4-430b-902f-e86c6f82305a" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f399df-4c5e-4a99-9248-35f70107779b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a Sep 28 16:09:23 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.216s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-213611605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874851cc-a8b3-4f99-8f28-75497938f7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:11Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Creating volume 874851cc-a8b3-4f99-8f28-75497938f7a9 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:24 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5195b49-4625-4f01-908b-f7bfad4dfa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22daec8-3810-4944-949d-a5db5acc5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:24 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 1073741824 Sep 28 16:09:24 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Volume volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 (c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5): created successfully Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22daec8-3810-4944-949d-a5db5acc5366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (69acb78e-f871-437e-ab54-3a4e1b6d0da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c2d4cfec-364d-4ba0-9c09-67d9744fbd84 tempest-CreateVolumesFromImageTest-1907235240 None] Created volume successfully. Sep 28 16:09:24 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a" returned: 0 in 0.441s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a Sep 28 16:09:24 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c085446f-85a4-430b-902f-e86c6f82305a" returned: 0 in 0.350s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c085446f-85a4-430b-902f-e86c6f82305a" released by "delete_volume" :: held 0.854s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['eb22d65a-7b9e-4ba0-87c3-1d7dedc05c0b', 'fa475a38-51c4-4b36-8124-57d079a54a08', 'f6fbf856-b44b-4ba7-bdd3-a2c2193d57da', '828c2261-3151-4566-90fc-a6f6a3cc7925'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 1073741824" returned: 0 in 0.747s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:24 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 Sep 28 16:09:24 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-770e5158-abe8-45d4-92d4-d8e39aa385e2" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-770e5158-abe8-45d4-92d4-d8e39aa385e2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Deleting offline snapshot c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 of volume 770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] snapshot_file for this snap is: volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:25 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d1488b-584b-42ab-a3bb-231cbe229634]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Deleted volume successfully. Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bd4a904b-9ebb-42d8-96c2-7fdbf4a48d06 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-c085446f-85a4-430b-902f-e86c6f82305a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:25 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9" returned: 0 in 0.539s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.130s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270079956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55f4bba-c32e-4286-80be-ad7e6c87a638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:11Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Creating volume f55f4bba-c32e-4286-80be-ad7e6c87a638 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:25 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 Sep 28 16:09:25 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:25 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd20a74-ff68-4045-a6f8-3fe89701fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874851cc-a8b3-4f99-8f28-75497938f7a9', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:25 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 1073741824 Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd304cd-2a0a-42ff-8a85-c9802f85f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:25 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Volume volume-874851cc-a8b3-4f99-8f28-75497938f7a9 (874851cc-a8b3-4f99-8f28-75497938f7a9): created successfully Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd304cd-2a0a-42ff-8a85-c9802f85f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (eab2335d-8f0e-4451-8f88-fa331eeff7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-aaf956f0-5ed9-447f-a47f-d406cbeab115 tempest-CreateVolumesFromImageTest-1907235240 None] Created volume successfully. Sep 28 16:09:25 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" returned: 0 in 0.718s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770e5158-abe8-45d4-92d4-d8e39aa385e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d2b5b-df03-4983-832a-76b9c660a2ea]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 Sep 28 16:09:26 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 1073741824" returned: 0 in 0.734s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 Sep 28 16:09:26 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638" returned: 0 in 0.404s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.834s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714696007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0118912-5e05-4ead-8cf5-3b4e32d9404b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bd4189e476432e922e7e5a344eea3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:12Z,use_quota=True,user_id='e4199635390e47769ab4397e6c5830e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Creating volume d0118912-5e05-4ead-8cf5-3b4e32d9404b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:26 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b 1073741824 Sep 28 16:09:26 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97646f9-f768-4fe4-b6b4-83bee35c759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55f4bba-c32e-4286-80be-ad7e6c87a638', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa2680-7603-4c2e-a218-777e276f3488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:26 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:26 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Volume volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 (f55f4bba-c32e-4286-80be-ad7e6c87a638): created successfully Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfa2680-7603-4c2e-a218-777e276f3488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (f15ef2f4-15b9-4270-8807-fa851034c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5f3f0af4-4022-4d70-bf01-e596844cffa4 tempest-CreateVolumesFromImageTest-1907235240 None] Created volume successfully. Sep 28 16:09:26 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2" returned: 0 in 0.967s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 Sep 28 16:09:26 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.463s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:09:27 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b 1073741824" returned: 0 in 0.762s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" returned: 0 in 0.593s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16 Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b Sep 28 16:09:27 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b" returned: 0 in 0.329s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.536s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1488775453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd681362d3494096113fa943fcfb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:21Z,use_quota=True,user_id='8f6286b6b5eb4512a547511a4b6ee184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Creating volume fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:27 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2.c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" returned: 0 in 0.397s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dcd104-e092-4b9f-8bb0-185f922a9d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:27 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e 1073741824 Sep 28 16:09:27 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51084ea4-8d62-40bb-a505-5862c857aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Volume volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b (d0118912-5e05-4ead-8cf5-3b4e32d9404b): created successfully Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51084ea4-8d62-40bb-a505-5862c857aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Flow 'volume_create_manager' (c5486fd9-ff46-461b-ba81-2e7d421225d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16" released by "_delete_snapshot" :: held 2.951s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-770e5158-abe8-45d4-92d4-d8e39aa385e2" released by "delete_snapshot" :: held 2.990s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d4bf0d87-342a-4511-9bc2-67c90ab87cb9 tempest-CreateVolumesFromImageTest-1907235240 None] Created volume successfully. Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['1994d9a7-37e3-4130-8393-582e51daccf8', '63e84868-e57b-4599-a7e8-f28417d2dd73', 'abfacfa4-5ad7-40fe-976f-c30e979d2414', 'b1bd3751-2e7b-4b4e-88a2-ff36100c50ef'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Delete snapshot completed successfully. Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-d0118912-5e05-4ead-8cf5-3b4e32d9404b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-30214244-c4b3-4227-aa03-a674e3259da6 tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-c82a3cc9-d0bb-4d13-a2b9-aa1b001efb16-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-d0118912-5e05-4ead-8cf5-3b4e32d9404b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-quobyte-d0118912-5e05-4ead-8cf5-3b4e32d9404b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-770e5158-abe8-45d4-92d4-d8e39aa385e2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-d0118912-5e05-4ead-8cf5-3b4e32d9404b" acquired by "delete_volume" :: waited 0.050s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-770e5158-abe8-45d4-92d4-d8e39aa385e2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bdd769-43c6-4f89-9b3d-d0dac2c636ba]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-770e5158-abe8-45d4-92d4-d8e39aa385e2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e 1073741824" returned: 0 in 0.805s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-770e5158-abe8-45d4-92d4-d8e39aa385e2" acquired by "delete_volume" :: waited 0.047s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b Sep 28 16:09:28 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2a0fa-49bf-4420-b138-3ae34a00274d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:28 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e Sep 28 16:09:28 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 Sep 28 16:09:29 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b" returned: 0 in 0.608s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e" returned: 0 in 0.371s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:29 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b Sep 28 16:09:29 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc85a06-5b73-488b-aed8-574334927be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ce7f82-5800-4284-ae85-f938b563da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Volume volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e (fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e): created successfully Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ce7f82-5800-4284-ae85-f938b563da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Flow 'volume_create_manager' (10860b27-cf5f-4a86-be69-ab3689a798d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-54efaaf0-20e9-419b-a22e-9581e616ffd1 tempest-AttachVolumeNegativeTest-1745245844 None] Created volume successfully. Sep 28 16:09:29 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2" returned: 0 in 0.635s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2 Sep 28 16:09:29 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d0118912-5e05-4ead-8cf5-3b4e32d9404b" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-d0118912-5e05-4ead-8cf5-3b4e32d9404b" released by "delete_volume" :: held 1.057s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Created reservations ['f861b3d4-d499-4506-8310-ef1ffce7845d', '93b05c96-0d64-4eee-b3d1-ac8ec1485b87', 'abc550d3-808d-435d-a82e-d197faae57a6', '66bcf46d-8087-498b-897a-fe2e4d46b445'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:29 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-770e5158-abe8-45d4-92d4-d8e39aa385e2" returned: 0 in 0.353s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-770e5158-abe8-45d4-92d4-d8e39aa385e2" released by "delete_volume" :: held 1.103s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['ffba20f9-d2de-4db0-a4cb-0f7009f37b36', '2595a2ed-3230-4a3e-8b3f-783b8a7add19', '5753f43e-4843-41ed-a5d9-32766f340b0a', '0e4acdcf-e428-4103-b91a-75ad9ee3cf02'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:30 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:30 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:30 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:30 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:30 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.456s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Deleted volume successfully. Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-693f362c-c1d7-4001-b1d0-3235f9f8a0a1 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-d0118912-5e05-4ead-8cf5-3b4e32d9404b-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:30 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.515s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Deleted volume successfully. Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-dbf4c565-0a02-492d-8c9a-3ada7f476eec tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-770e5158-abe8-45d4-92d4-d8e39aa385e2-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-f55f4bba-c32e-4286-80be-ad7e6c87a638-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-f55f4bba-c32e-4286-80be-ad7e6c87a638-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-quobyte-f55f4bba-c32e-4286-80be-ad7e6c87a638" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-f55f4bba-c32e-4286-80be-ad7e6c87a638" acquired by "delete_volume" :: waited 0.061s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c679a57-984e-444b-9156-b1b7b20a5227]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-b40762ba-f4bc-416c-9cb3-c7c8d617930c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-b40762ba-f4bc-416c-9cb3-c7c8d617930c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "cinder-quobyte-b40762ba-f4bc-416c-9cb3-c7c8d617930c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40762ba-f4bc-416c-9cb3-c7c8d617930c" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:31 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 Sep 28 16:09:31 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0e1ff-f6e6-400f-bc33-37613e955146]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c Sep 28 16:09:31 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-bca0f18a-fd99-4791-9f25-3de043bdabe8 req-57cefd81-f547-46ed-839e-9b45aa359d56 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-bca0f18a-fd99-4791-9f25-3de043bdabe8 req-57cefd81-f547-46ed-839e-9b45aa359d56 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-bca0f18a-fd99-4791-9f25-3de043bdabe8 req-57cefd81-f547-46ed-839e-9b45aa359d56 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-bca0f18a-fd99-4791-9f25-3de043bdabe8 req-57cefd81-f547-46ed-839e-9b45aa359d56 tempest-AttachVolumeNegativeTest-1745245844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4cc8f00-925e-492c-b89b-76ee98e423ce', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:09:31 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638" returned: 0 in 0.742s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638 Sep 28 16:09:31 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-bca0f18a-fd99-4791-9f25-3de043bdabe8 req-57cefd81-f547-46ed-839e-9b45aa359d56 tempest-AttachVolumeNegativeTest-1745245844 None] attachment_update completed successfully. Sep 28 16:09:31 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c" returned: 0 in 0.664s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c Sep 28 16:09:31 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:32 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f55f4bba-c32e-4286-80be-ad7e6c87a638" returned: 0 in 0.403s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-f55f4bba-c32e-4286-80be-ad7e6c87a638" released by "delete_volume" :: held 1.247s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:32 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Created reservations ['4380f5d8-e8dc-41a5-a33b-f896d84c1c95', '1989fa40-1421-410e-b298-61ddb4f1fa07', 'd5b5ad2c-f91a-47b4-bc01-f6cce02a3983', '22d300cf-754e-41b4-bb68-ab4b2c94ad7e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b40762ba-f4bc-416c-9cb3-c7c8d617930c" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-quobyte-b40762ba-f4bc-416c-9cb3-c7c8d617930c" released by "delete_volume" :: held 1.142s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Created reservations ['5e27cd34-7c86-4196-b467-98030c0150f4', 'dcb53eb5-2e65-47bd-9b76-d16aa4abda59', '73c8deb8-bf3d-4734-8b70-2ccef02e30df', '1abbd520-5110-4f34-a62a-5a174a2e66b6'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:32 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:32 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:32 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:32 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:32 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.449s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Deleted volume successfully. Sep 28 16:09:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2941a8f0-7fad-4e9f-a1e7-8bbd27e2f376 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-f55f4bba-c32e-4286-80be-ad7e6c87a638-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:33 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.404s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Deleted volume successfully. Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-96d10270-e6bd-4421-8cd4-7e9d69e7425d tempest-VolumesSnapshotTestJSON-610720810 None] Lock "cinder-b40762ba-f4bc-416c-9cb3-c7c8d617930c-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-874851cc-a8b3-4f99-8f28-75497938f7a9-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-874851cc-a8b3-4f99-8f28-75497938f7a9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-quobyte-874851cc-a8b3-4f99-8f28-75497938f7a9" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-874851cc-a8b3-4f99-8f28-75497938f7a9" acquired by "delete_volume" :: waited 0.046s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d9c37-e8bf-4f36-9717-a6ff4d46e774]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 Sep 28 16:09:33 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:34 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9" returned: 0 in 0.561s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:34 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9 Sep 28 16:09:34 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:34 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-874851cc-a8b3-4f99-8f28-75497938f7a9" returned: 0 in 0.287s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-874851cc-a8b3-4f99-8f28-75497938f7a9" released by "delete_volume" :: held 0.945s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Created reservations ['9ee4a8d1-2d55-4a35-90b1-b12f82c08ca3', '70db5d38-5558-449c-8555-039c050ffc8a', '906d73b6-d692-4ca2-a068-ffe8d56d51f9', 'e14741e7-6f36-46c6-8830-bf7a7d1c2e62'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:34 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:34 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:35 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.508s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Deleted volume successfully. Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d1501fd6-d936-4622-aca1-afcfb0ccd477 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-874851cc-a8b3-4f99-8f28-75497938f7a9-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-quobyte-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5" acquired by "delete_volume" :: waited 0.053s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f116f2d-6c59-4957-91ea-eadabf11374d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:36 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 Sep 28 16:09:36 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-afbb5a2b-fb8b-41d6-a868-cd82278e15a9 req-58103206-4996-4b06-a77a-7bf38387caf9 tempest-AttachVolumeNegativeTest-1745245844 None] Terminate volume connection completed successfully. Sep 28 16:09:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-afbb5a2b-fb8b-41d6-a868-cd82278e15a9 req-58103206-4996-4b06-a77a-7bf38387caf9 tempest-AttachVolumeNegativeTest-1745245844 None] Deleting attachment d4cc8f00-925e-492c-b89b-76ee98e423ce. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:09:36 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5" returned: 0 in 0.659s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:36 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5 Sep 28 16:09:36 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:37 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5" released by "delete_volume" :: held 1.171s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Created reservations ['79def51e-57a5-493b-8642-2b03a624c026', '627dc297-dbaf-45ef-a95e-e1494ed992b8', '38c29cf6-9d15-47d1-aa2f-304bbbc5b855', '70cf55ed-8022-4512-be90-cc4c94ae355f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:37 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:37 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:37 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Deleted volume successfully. Sep 28 16:09:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd7eea90-85fe-48f6-90e4-3e772333ed86 tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-c7a5eea3-0b82-4d4f-8a2d-4e0117d624a5-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-6508d92b-9892-4616-b878-18c06ff4a0b7-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-6508d92b-9892-4616-b878-18c06ff4a0b7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "cinder-quobyte-6508d92b-9892-4616-b878-18c06ff4a0b7" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-6508d92b-9892-4616-b878-18c06ff4a0b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca22f31-a9eb-486b-a679-c3ca47933d67]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:38 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 Sep 28 16:09:38 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7" returned: 0 in 0.750s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7 Sep 28 16:09:39 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6508d92b-9892-4616-b878-18c06ff4a0b7" returned: 0 in 0.356s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-quobyte-6508d92b-9892-4616-b878-18c06ff4a0b7" released by "delete_volume" :: held 1.175s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Created reservations ['f74c3762-24f4-45a6-98e4-c5e54d4745d1', '00461fc2-a222-4e0f-a501-7fe369cc8e29', 'a6f5e1cb-364b-4912-925b-231b202effc3', 'd9872350-f216-4ed6-82f8-fd6883545f04'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:09:39 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:40 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.306s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:40 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Deleted volume successfully. Sep 28 16:09:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7318cda0-c042-49f7-a93b-624f6bad471d tempest-CreateVolumesFromImageTest-1907235240 None] Lock "cinder-6508d92b-9892-4616-b878-18c06ff4a0b7-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (f1b9b7f7-4cb5-4859-9098-ba3e5f632c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73666ef2-7eec-4aa8-b9bd-c08654153d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73666ef2-7eec-4aa8-b9bd-c08654153d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902481975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a020be-412e-453d-a6d8-f536cd6bdb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:48Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bc8036-85e1-4f3f-a833-16a7eb842143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bc8036-85e1-4f3f-a833-16a7eb842143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2695171-af2e-405d-89b4-ef0ede02e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2695171-af2e-405d-89b4-ef0ede02e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a020be-412e-453d-a6d8-f536cd6bdb9b', 'volume_name': 'volume-94a020be-412e-453d-a6d8-f536cd6bdb9b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a525b7-c503-48bd-8699-9d55e610c4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a525b7-c503-48bd-8699-9d55e610c4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138b42b5-ff37-444b-ba23-4b90a05a1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:48 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume 94a020be-412e-453d-a6d8-f536cd6bdb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a020be-412e-453d-a6d8-f536cd6bdb9b', 'volume_size': 1} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902481975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a020be-412e-453d-a6d8-f536cd6bdb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:48Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating volume 94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:48 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:48 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b 1073741824 Sep 28 16:09:48 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b 1073741824" returned: 0 in 1.002s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b Sep 28 16:09:49 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b" returned: 0 in 0.401s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138b42b5-ff37-444b-ba23-4b90a05a1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a020be-412e-453d-a6d8-f536cd6bdb9b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a29a509-5982-4a37-bb2e-6fe0fa5697dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Flow 'volume_create_manager' (c017271c-7278-4ca0-861f-90742a73fd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dbda7e-0313-4d17-aabb-e861f13a8e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dbda7e-0313-4d17-aabb-e861f13a8e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2138554365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c011df2a-8906-40e0-bedc-d47fdb0cf2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829ccdcc81c4d73a45574ec03e57880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:50Z,use_quota=True,user_id='580d4cce120b4435a624e6c03982bcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7535587-a87c-4626-a01c-c3c68548b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7535587-a87c-4626-a01c-c3c68548b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b6d472-f09d-4ff8-8d46-839324fa3031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b6d472-f09d-4ff8-8d46-839324fa3031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c011df2a-8906-40e0-bedc-d47fdb0cf2cd', 'volume_name': 'volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbca2a4e-d9e4-476f-aa9e-8fe63ce7f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbca2a4e-d9e4-476f-aa9e-8fe63ce7f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e77c6ce-097f-40e4-86aa-4f55d91101d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Volume c011df2a-8906-40e0-bedc-d47fdb0cf2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd', 'volume_size': 1} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2138554365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c011df2a-8906-40e0-bedc-d47fdb0cf2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829ccdcc81c4d73a45574ec03e57880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:50Z,use_quota=True,user_id='580d4cce120b4435a624e6c03982bcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Creating volume c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:50 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume volume-94a020be-412e-453d-a6d8-f536cd6bdb9b (94a020be-412e-453d-a6d8-f536cd6bdb9b): created successfully Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a29a509-5982-4a37-bb2e-6fe0fa5697dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (f1b9b7f7-4cb5-4859-9098-ba3e5f632c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:50 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd 1073741824 Sep 28 16:09:50 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7d2d6f87-fb71-4358-9d06-7720a1e7ea30 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created volume successfully. Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:51 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd 1073741824" returned: 0 in 0.852s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:51 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd Sep 28 16:09:51 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:51 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" returned: 0 in 0.472s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.623s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e77c6ce-097f-40e4-86aa-4f55d91101d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc3280f-328c-48f5-a88a-3098fd4a7b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating offline snapshot 528f1a2e-0a55-445d-be2a-0f1220e04362 of volume 94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:51 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Volume volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd (c011df2a-8906-40e0-bedc-d47fdb0cf2cd): created successfully Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc3280f-328c-48f5-a88a-3098fd4a7b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Flow 'volume_create_manager' (c017271c-7278-4ca0-861f-90742a73fd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69dde40-ddfb-4bad-9995-8ec46e7e9e95]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-85840990-c4ce-4895-85e9-cf6003911294 tempest-TestStampPattern-1221211916 None] Created volume successfully. Sep 28 16:09:51 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b Sep 28 16:09:51 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:52 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b" returned: 0 in 0.571s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:52 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 1G Sep 28 16:09:52 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 1G" returned: 0 in 0.786s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a020be-412e-453d-a6d8-f536cd6bdb9b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a020be-412e-453d-a6d8-f536cd6bdb9b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 Sep 28 16:09:53 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a020be-412e-453d-a6d8-f536cd6bdb9b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362" returned: 0 in 0.628s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 is being set with open permissions: ugo+rw Sep 28 16:09:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 Sep 28 16:09:53 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info Sep 28 16:09:54 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info" returned: 0 in 0.457s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info is being set with open permissions: ugo+rw Sep 28 16:09:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info Sep 28 16:09:54 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:55 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.info" returned: 0 in 0.310s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.418s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-af70e3a6-cac3-4f50-9239-81aeedcfb307 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Create snapshot completed successfully Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (f1679b52-68e2-4cf9-be09-4c0a5c51b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d42a901-1c04-440c-a39e-cd0b9d9b0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d42a901-1c04-440c-a39e-cd0b9d9b0b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-383858225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0804331-41d8-4274-86c4-54f521afb17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:56Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81202dc9-4686-414e-bd18-95be5bc0dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81202dc9-4686-414e-bd18-95be5bc0dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95811649-6bac-42a0-a9db-3d8f274300a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95811649-6bac-42a0-a9db-3d8f274300a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0804331-41d8-4274-86c4-54f521afb17a', 'volume_name': 'volume-e0804331-41d8-4274-86c4-54f521afb17a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0526cc-7804-47ed-bc2b-53b364c92ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0526cc-7804-47ed-bc2b-53b364c92ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c368859d-5cee-4167-913b-ec402418032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume e0804331-41d8-4274-86c4-54f521afb17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0804331-41d8-4274-86c4-54f521afb17a', 'volume_size': 1} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-383858225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0804331-41d8-4274-86c4-54f521afb17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:56Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating volume e0804331-41d8-4274-86c4-54f521afb17a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:56 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:56 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a 1073741824 Sep 28 16:09:56 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (737af527-49c5-4586-821f-c82d59da360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532634c1-7d32-437a-8065-8fd85e4b3f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532634c1-7d32-437a-8065-8fd85e4b3f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451467680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31128d30-b790-4f39-b4b8-0c78577ce365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:57Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf50d682-5beb-4f6e-85ab-590c196138e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf50d682-5beb-4f6e-85ab-590c196138e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2b3b9b-fef0-4480-ab8d-a145c891cd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2b3b9b-fef0-4480-ab8d-a145c891cd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31128d30-b790-4f39-b4b8-0c78577ce365', 'volume_name': 'volume-31128d30-b790-4f39-b4b8-0c78577ce365', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c5e6b8-ac12-4433-a9a8-804cdb710cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c5e6b8-ac12-4433-a9a8-804cdb710cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba2ca16-00d0-4f45-b338-d0d140ebd862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume 31128d30-b790-4f39-b4b8-0c78577ce365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31128d30-b790-4f39-b4b8-0c78577ce365', 'volume_size': 1} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:57 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a 1073741824" returned: 0 in 0.843s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:57 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a Sep 28 16:09:57 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (7153e494-be58-4298-bf19-6070c6788f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257fe2bd-ed53-4910-81a4-8b9979317576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257fe2bd-ed53-4910-81a4-8b9979317576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786601536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a34eb17-2cc4-440d-ac26-d70164e2ecc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:57Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979b2fec-2ea6-4568-a482-a68f55b0e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979b2fec-2ea6-4568-a482-a68f55b0e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84165fa-5800-45a9-ad61-78807cb60a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84165fa-5800-45a9-ad61-78807cb60a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a34eb17-2cc4-440d-ac26-d70164e2ecc9', 'volume_name': 'volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f1bb8f-6337-4e91-b7bd-2ad37967ed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f1bb8f-6337-4e91-b7bd-2ad37967ed8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78de869d-43f5-4772-905a-c610aaa64e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume 2a34eb17-2cc4-440d-ac26-d70164e2ecc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9', 'volume_size': 1} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:57 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a" returned: 0 in 0.452s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451467680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31128d30-b790-4f39-b4b8-0c78577ce365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:57Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating volume 31128d30-b790-4f39-b4b8-0c78577ce365 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:57 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c368859d-5cee-4167-913b-ec402418032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0804331-41d8-4274-86c4-54f521afb17a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 1073741824 Sep 28 16:09:57 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d404b80-e7b5-4e29-bcc5-0b8c351569fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume volume-e0804331-41d8-4274-86c4-54f521afb17a (e0804331-41d8-4274-86c4-54f521afb17a): created successfully Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d404b80-e7b5-4e29-bcc5-0b8c351569fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (f1679b52-68e2-4cf9-be09-4c0a5c51b306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-15404637-2021-4742-8567-49a097b9962c tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created volume successfully. Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (ea8f6a75-d174-47ab-9f38-8ed73b1ba210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d55caa-7867-45fb-afef-23626fa8a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d55caa-7867-45fb-afef-23626fa8a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1471281087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f854b35-40d6-479f-94ba-26122e6486b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:58Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3dc30-f8d5-4cdc-b786-3e8481e772b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3dc30-f8d5-4cdc-b786-3e8481e772b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efeac04-fcd4-4e9a-85ef-a012712d3aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efeac04-fcd4-4e9a-85ef-a012712d3aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f854b35-40d6-479f-94ba-26122e6486b2', 'volume_name': 'volume-4f854b35-40d6-479f-94ba-26122e6486b2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9031898-67a2-4017-99ca-c36c19036350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9031898-67a2-4017-99ca-c36c19036350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07daedd4-0ab2-4755-b511-19b013cf9c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume 4f854b35-40d6-479f-94ba-26122e6486b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f854b35-40d6-479f-94ba-26122e6486b2', 'volume_size': 1} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:58 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 1073741824" returned: 0 in 0.798s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:58 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 Sep 28 16:09:58 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (f94ae869-f6c7-42af-9600-f57e95d5f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bc3870-4694-43df-a50e-94ec593105df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bc3870-4694-43df-a50e-94ec593105df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721986284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3aa66d-07b6-470a-9845-a323f58de41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:59Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a765f1a4-1f1a-4664-a154-ce71e37182e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a765f1a4-1f1a-4664-a154-ce71e37182e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dd6833-89b9-429f-8cfa-c395f8cca661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:59 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dd6833-89b9-429f-8cfa-c395f8cca661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3aa66d-07b6-470a-9845-a323f58de41e', 'volume_name': 'volume-cb3aa66d-07b6-470a-9845-a323f58de41e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e329030d-6748-4977-ac50-94f68bc918a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e329030d-6748-4977-ac50-94f68bc918a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89699f90-e385-4228-b349-887e11e520a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume cb3aa66d-07b6-470a-9845-a323f58de41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3aa66d-07b6-470a-9845-a323f58de41e', 'volume_size': 1} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365" returned: 0 in 0.457s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786601536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a34eb17-2cc4-440d-ac26-d70164e2ecc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:57Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating volume 2a34eb17-2cc4-440d-ac26-d70164e2ecc9 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:59 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba2ca16-00d0-4f45-b338-d0d140ebd862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31128d30-b790-4f39-b4b8-0c78577ce365', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05894ed-6e42-4f4f-a0ab-fe8ce7950898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:59 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 1073741824 Sep 28 16:09:59 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume volume-31128d30-b790-4f39-b4b8-0c78577ce365 (31128d30-b790-4f39-b4b8-0c78577ce365): created successfully Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05894ed-6e42-4f4f-a0ab-fe8ce7950898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (737af527-49c5-4586-821f-c82d59da360b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-258a99b6-e2dd-4ef6-86a2-c87558e663a6 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created volume successfully. Sep 28 16:10:00 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 1073741824" returned: 0 in 1.013s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:00 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 Sep 28 16:10:00 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:00 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9" returned: 0 in 0.720s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.534s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1471281087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f854b35-40d6-479f-94ba-26122e6486b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:58Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating volume 4f854b35-40d6-479f-94ba-26122e6486b2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:01 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78de869d-43f5-4772-905a-c610aaa64e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fe118c-d47f-453e-b0a1-ad5efb50ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:01 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 1073741824 Sep 28 16:10:01 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 (2a34eb17-2cc4-440d-ac26-d70164e2ecc9): created successfully Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fe118c-d47f-453e-b0a1-ad5efb50ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (7153e494-be58-4298-bf19-6070c6788f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3d750b41-31be-421c-9b34-9ca3ad0c2d44 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created volume successfully. Sep 28 16:10:02 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 1073741824" returned: 0 in 1.178s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:02 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 Sep 28 16:10:02 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:02 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2" returned: 0 in 0.529s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721986284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3aa66d-07b6-470a-9845-a323f58de41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd8a9a78d444073b1b9103816943f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:59Z,use_quota=True,user_id='d67087a54d714d138e7009450c043c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Creating volume cb3aa66d-07b6-470a-9845-a323f58de41e {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:02 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07daedd4-0ab2-4755-b511-19b013cf9c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f854b35-40d6-479f-94ba-26122e6486b2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e 1073741824 Sep 28 16:10:02 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d93497f-7ee0-4859-a911-a3f8253ad2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume volume-4f854b35-40d6-479f-94ba-26122e6486b2 (4f854b35-40d6-479f-94ba-26122e6486b2): created successfully Sep 28 16:10:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d93497f-7ee0-4859-a911-a3f8253ad2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (ea8f6a75-d174-47ab-9f38-8ed73b1ba210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:03 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c00b6d1c-5605-4ba0-8b18-ee1819f59122 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created volume successfully. Sep 28 16:10:04 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e 1073741824" returned: 0 in 1.236s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:04 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e Sep 28 16:10:04 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:04 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e" returned: 0 in 0.656s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89699f90-e385-4228-b349-887e11e520a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3aa66d-07b6-470a-9845-a323f58de41e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024bef27-2b8b-449f-a8fc-34305d0926aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Volume volume-cb3aa66d-07b6-470a-9845-a323f58de41e (cb3aa66d-07b6-470a-9845-a323f58de41e): created successfully Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024bef27-2b8b-449f-a8fc-34305d0926aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Flow 'volume_create_manager' (f94ae869-f6c7-42af-9600-f57e95d5f698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e9907698-c956-4c60-9c58-0a04f16bcccd tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created volume successfully. Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-cb3aa66d-07b6-470a-9845-a323f58de41e-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-cb3aa66d-07b6-470a-9845-a323f58de41e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-cb3aa66d-07b6-470a-9845-a323f58de41e" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-cb3aa66d-07b6-470a-9845-a323f58de41e" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d47a21-b6e5-44df-9804-dbfb17f735ec]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:05 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e Sep 28 16:10:05 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:06 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e" returned: 0 in 0.734s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:06 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e Sep 28 16:10:06 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:06 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb3aa66d-07b6-470a-9845-a323f58de41e" returned: 0 in 0.470s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-cb3aa66d-07b6-470a-9845-a323f58de41e" released by "delete_volume" :: held 1.302s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['f26e9b68-6831-472a-8e6c-ebccd1753bb1', '7521dd3d-f5dc-430a-95d3-afba7ae507fc', 'b777c8f7-d7ca-4a20-ab65-2cf24d62adb0', 'cb6ad327-4cee-4626-a403-ce0abf5731f2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:07 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:07 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:07 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.638s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:07 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleted volume successfully. Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-883d0aa5-c6bb-4cee-b7f1-51ec2f69ed53 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-cb3aa66d-07b6-470a-9845-a323f58de41e-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-4f854b35-40d6-479f-94ba-26122e6486b2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-4f854b35-40d6-479f-94ba-26122e6486b2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-4f854b35-40d6-479f-94ba-26122e6486b2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-4f854b35-40d6-479f-94ba-26122e6486b2" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f001a57c-2dfb-4d44-856b-1dbf59c25620]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:08 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 Sep 28 16:10:08 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:09 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2" returned: 0 in 0.706s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:09 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2 Sep 28 16:10:09 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:09 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4f854b35-40d6-479f-94ba-26122e6486b2" returned: 0 in 0.589s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-4f854b35-40d6-479f-94ba-26122e6486b2" released by "delete_volume" :: held 1.392s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['4d7dbb62-e689-488e-87dc-cf0bea7f5aa9', '202ef7da-2632-4565-aa0d-ffd5db80374e', 'e611d9d4-145a-4b2f-af1d-a31464a5993d', '0c5bb798-aea5-4a5a-9de6-80eee4b66d6d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:09 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:10 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:10 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleted volume successfully. Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-131f882b-a55a-4918-9152-1c27c4eea75a tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-4f854b35-40d6-479f-94ba-26122e6486b2-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-2a34eb17-2cc4-440d-ac26-d70164e2ecc9-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-2a34eb17-2cc4-440d-ac26-d70164e2ecc9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-2a34eb17-2cc4-440d-ac26-d70164e2ecc9" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-2a34eb17-2cc4-440d-ac26-d70164e2ecc9" acquired by "delete_volume" :: waited 0.066s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b1374-bc6a-4acc-ac99-a88be4d88f7f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:11 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 Sep 28 16:10:11 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:11 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9" returned: 0 in 0.849s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:11 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9 Sep 28 16:10:11 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:12 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2a34eb17-2cc4-440d-ac26-d70164e2ecc9" returned: 0 in 0.527s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-2a34eb17-2cc4-440d-ac26-d70164e2ecc9" released by "delete_volume" :: held 1.486s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['83e54c35-399f-49f1-bb37-06b8b05935a2', '8f0c482a-3d0c-43f3-9e89-090fb89b3d14', '0562571e-22df-47fd-a875-f8008ecac323', 'ef5dc191-f86b-4e7f-b7d1-40e4dbdb5bbe'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:12 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:12 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:13 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.563s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleted volume successfully. Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-122e1270-642a-4808-a6f3-63ead38765a5 tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-2a34eb17-2cc4-440d-ac26-d70164e2ecc9-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-31128d30-b790-4f39-b4b8-0c78577ce365-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-31128d30-b790-4f39-b4b8-0c78577ce365-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-31128d30-b790-4f39-b4b8-0c78577ce365" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-31128d30-b790-4f39-b4b8-0c78577ce365" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9177ef75-4ed4-42fa-9e67-894d574b2e07]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:13 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 Sep 28 16:10:13 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:14 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365" returned: 0 in 0.860s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:14 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365 Sep 28 16:10:14 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:15 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-31128d30-b790-4f39-b4b8-0c78577ce365" returned: 0 in 0.627s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-31128d30-b790-4f39-b4b8-0c78577ce365" released by "delete_volume" :: held 1.563s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['94354792-bf41-4a12-a891-0066e3769018', '3ee2623e-847d-4230-bff4-66431b696051', '3fc61f06-4f1d-478e-ae32-60c423ea8b93', '994bf954-bdcb-42f5-8bde-244da873ced0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:15 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:15 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:16 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.485s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleted volume successfully. Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-e0804331-41d8-4274-86c4-54f521afb17a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-e0804331-41d8-4274-86c4-54f521afb17a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cdfa437-d18e-43a1-8ac7-cea5dcaf902e tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-31128d30-b790-4f39-b4b8-0c78577ce365-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-e0804331-41d8-4274-86c4-54f521afb17a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-e0804331-41d8-4274-86c4-54f521afb17a" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ad9d9-31b6-46da-8076-d00bf073d2e5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:16 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a Sep 28 16:10:16 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:16 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a" returned: 0 in 0.537s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:16 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a Sep 28 16:10:16 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:17 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e0804331-41d8-4274-86c4-54f521afb17a" returned: 0 in 0.546s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-e0804331-41d8-4274-86c4-54f521afb17a" released by "delete_volume" :: held 1.157s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['a06d60b2-c84d-4b1e-af0f-4f424a6ccef8', 'a0373658-b66d-4c76-bb09-a05b03b33fe8', '9c5ab9f8-0959-4186-b40b-f44f05ac4938', '22a073a4-0326-4bd5-9d7e-d37b252fed20'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:17 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:17 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:18 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleted volume successfully. Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8370d7a3-24bb-4de7-b762-b0a182eb0d9b tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-e0804331-41d8-4274-86c4-54f521afb17a-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-528f1a2e-0a55-445d-be2a-0f1220e04362-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-528f1a2e-0a55-445d-be2a-0f1220e04362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-94a020be-412e-453d-a6d8-f536cd6bdb9b" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-94a020be-412e-453d-a6d8-f536cd6bdb9b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-528f1a2e-0a55-445d-be2a-0f1220e04362" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-528f1a2e-0a55-445d-be2a-0f1220e04362" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleting offline snapshot 528f1a2e-0a55-445d-be2a-0f1220e04362 of volume 94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] snapshot_file for this snap is: volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf7994-eec3-4a85-9334-34f1e4e3e2b9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:19 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 Sep 28 16:10:19 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:20 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362" returned: 0 in 1.003s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a020be-412e-453d-a6d8-f536cd6bdb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[306d552e-af66-4422-b334-3a09ee694a61]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:20 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b Sep 28 16:10:20 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:21 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b" returned: 0 in 0.931s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:21 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 Sep 28 16:10:21 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:21 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362" returned: 0 in 0.914s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:22 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362 Sep 28 16:10:22 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:22 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b.528f1a2e-0a55-445d-be2a-0f1220e04362" returned: 0 in 0.540s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-528f1a2e-0a55-445d-be2a-0f1220e04362" released by "_delete_snapshot" :: held 3.688s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-94a020be-412e-453d-a6d8-f536cd6bdb9b" released by "delete_snapshot" :: held 3.744s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:22 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['cf2ca8a2-8aec-48e6-a99b-8aa08416ddf1', 'fb0d12bb-0d56-49e8-b56f-70ff66178fcf', '92d74018-0741-4fdc-8d28-f9061205896d', 'b2dcefb0-49b3-4894-8691-e95da20e5a84'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Delete snapshot completed successfully. Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f8dfb54-3415-450a-8b0a-0c01c226ae8f tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-528f1a2e-0a55-445d-be2a-0f1220e04362-delete_snapshot" released by "delete_snapshot" :: held 4.181s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-94a020be-412e-453d-a6d8-f536cd6bdb9b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-94a020be-412e-453d-a6d8-f536cd6bdb9b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=151,cinder:SELECT=117,cinder:INSERT=35,cinder:DELETE=15 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=99,cinder:INSERT=39,cinder:UPDATE=158,cinder:DELETE=12 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "cinder-quobyte-94a020be-412e-453d-a6d8-f536cd6bdb9b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-94a020be-412e-453d-a6d8-f536cd6bdb9b" acquired by "delete_volume" :: waited 0.060s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc0c5cb-57d2-4a2c-83ae-1cf4c0ad04d8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:23 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b Sep 28 16:10:23 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:24 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b" returned: 0 in 0.640s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:24 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b Sep 28 16:10:24 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:24 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-94a020be-412e-453d-a6d8-f536cd6bdb9b" returned: 0 in 0.564s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-quobyte-94a020be-412e-453d-a6d8-f536cd6bdb9b" released by "delete_volume" :: held 1.368s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:24 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Created reservations ['63edc334-9b55-4c39-a0c0-735465a02aa7', '9037ad1f-cb6d-4fee-b4e1-4ab9ff2ff51a', '99baca1f-e9cd-4550-bd3f-d4e928b4ee12', '46b4b497-b83d-482b-9350-6cd6079d1f13'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:25 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:25 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:25 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.556s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Deleted volume successfully. Sep 28 16:10:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9aefeb0b-5a41-425c-8ea4-1d1f444873fc tempest-CreateVolumesFromSnapshotTest-1924762280 None] Lock "cinder-94a020be-412e-453d-a6d8-f536cd6bdb9b-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:26 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:26 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:27 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:10:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:10:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Flow 'volume_create_manager' (37130959-2b61-48d5-9f29-ff4ecc6cee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b44b617-4f05-4ea5-8f02-3d00e3537698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b44b617-4f05-4ea5-8f02-3d00e3537698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2086135898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62c4aa3-32a1-4d46-b054-fa4c0f8093d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475f4447144345fe910eff31004ce9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:34Z,use_quota=True,user_id='922ebd9f48ae4d20b829884cdf708626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29b8a66-39e5-4460-8554-f82e217fa10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29b8a66-39e5-4460-8554-f82e217fa10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2e43f4-c512-426b-8572-e8a13529e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2e43f4-c512-426b-8572-e8a13529e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62c4aa3-32a1-4d46-b054-fa4c0f8093d2', 'volume_name': 'volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461156dd-8fb3-4e6e-b8a1-53c1167033a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461156dd-8fb3-4e6e-b8a1-53c1167033a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304d413d-f43c-4ea0-8761-112fa4035417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:34 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Volume f62c4aa3-32a1-4d46-b054-fa4c0f8093d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2', 'volume_size': 1} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2086135898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62c4aa3-32a1-4d46-b054-fa4c0f8093d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475f4447144345fe910eff31004ce9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:34Z,use_quota=True,user_id='922ebd9f48ae4d20b829884cdf708626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Creating volume f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:34 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 1073741824 Sep 28 16:10:34 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-b611fb08-75b3-42fb-bf2e-ef53fe4eb398 req-78c2bbe7-883d-4498-9b49-ef2752fde207 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:35 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 1073741824" returned: 0 in 0.986s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:35 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 Sep 28 16:10:35 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:35 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" returned: 0 in 0.500s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-b611fb08-75b3-42fb-bf2e-ef53fe4eb398 req-78c2bbe7-883d-4498-9b49-ef2752fde207 tempest-TestStampPattern-1221211916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.022s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-b611fb08-75b3-42fb-bf2e-ef53fe4eb398 req-78c2bbe7-883d-4498-9b49-ef2752fde207 tempest-TestStampPattern-1221211916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304d413d-f43c-4ea0-8761-112fa4035417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dbcde2-840e-43ab-8b20-333a5d5f7ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:35 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Volume volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 (f62c4aa3-32a1-4d46-b054-fa4c0f8093d2): created successfully Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dbcde2-840e-43ab-8b20-333a5d5f7ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Flow 'volume_create_manager' (37130959-2b61-48d5-9f29-ff4ecc6cee1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-b611fb08-75b3-42fb-bf2e-ef53fe4eb398 req-78c2bbe7-883d-4498-9b49-ef2752fde207 tempest-TestStampPattern-1221211916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a473686d-fdb0-4609-81d4-2a07b14ffa2d', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:10:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8bcf1d06-f887-4791-8431-5ecd098dcaa0 tempest-VolumeDependencyTests-853515879 None] Created volume successfully. Sep 28 16:10:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-b611fb08-75b3-42fb-bf2e-ef53fe4eb398 req-78c2bbe7-883d-4498-9b49-ef2752fde207 tempest-TestStampPattern-1221211916 None] attachment_update completed successfully. Sep 28 16:10:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Creating offline snapshot e9b33502-bffe-4ee6-8482-6047d5307caf of volume f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:36 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2581a3-5876-4f09-a69b-166b193d3f7d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:37 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 Sep 28 16:10:37 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:37 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" returned: 0 in 0.816s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:37 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf 1G Sep 28 16:10:37 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:38 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf 1G" returned: 0 in 0.668s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:38 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf Sep 28 16:10:38 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:38 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf" returned: 0 in 0.578s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf is being set with open permissions: ugo+rw Sep 28 16:10:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:39 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf Sep 28 16:10:39 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:39 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf" returned: 0 in 0.436s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:39 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info Sep 28 16:10:39 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:39 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info" returned: 0 in 0.397s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info is being set with open permissions: ugo+rw Sep 28 16:10:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:39 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info Sep 28 16:10:39 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:40 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.info" returned: 0 in 0.399s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.451s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7e960e8c-b681-4284-9b6f-dbeefebf4bd1 tempest-VolumeDependencyTests-853515879 None] Create snapshot completed successfully Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Flow 'volume_create_manager' (9b22171b-7dc2-4e54-94a5-77fd107bed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021b3b0-688e-46ca-9404-c4850e0e4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021b3b0-688e-46ca-9404-c4850e0e4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-801708190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec6c010-e662-482f-a88b-72a182b08570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475f4447144345fe910eff31004ce9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9b33502-bffe-4ee6-8482-6047d5307caf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:42Z,use_quota=True,user_id='922ebd9f48ae4d20b829884cdf708626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e39d21-caf2-4ab5-a73b-71b456f9cebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e39d21-caf2-4ab5-a73b-71b456f9cebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47903612-96ac-4b5d-a77d-09c0b80c6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47903612-96ac-4b5d-a77d-09c0b80c6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ec6c010-e662-482f-a88b-72a182b08570', 'volume_name': 'volume-7ec6c010-e662-482f-a88b-72a182b08570', 'volume_size': 1, 'snapshot_id': 'e9b33502-bffe-4ee6-8482-6047d5307caf'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4febaf-5e15-4cbb-a421-5fcadfeaec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4febaf-5e15-4cbb-a421-5fcadfeaec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8ee7f-645d-46ec-a565-5c8012fce738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:41 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Volume 7ec6c010-e662-482f-a88b-72a182b08570: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ec6c010-e662-482f-a88b-72a182b08570', 'volume_size': 1, 'snapshot_id': 'e9b33502-bffe-4ee6-8482-6047d5307caf'} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-quobyte-e9b33502-bffe-4ee6-8482-6047d5307caf-7ec6c010-e662-482f-a88b-72a182b08570" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-e9b33502-bffe-4ee6-8482-6047d5307caf-7ec6c010-e662-482f-a88b-72a182b08570" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Creating volume 7ec6c010-e662-482f-a88b-72a182b08570 from snapshot e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-quobyte-7ec6c010-e662-482f-a88b-72a182b08570" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-7ec6c010-e662-482f-a88b-72a182b08570" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] snapshot: e9b33502-bffe-4ee6-8482-6047d5307caf, volume: 7ec6c010-e662-482f-a88b-72a182b08570, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[22846dbe-20ef-4458-a714-2be6549fbed2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Flow 'volume_create_manager' (a7fa8d91-fa0d-49f1-8eed-06b4dd5f5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afb6dfc-4d4c-4739-9a83-61427adf2f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afb6dfc-4d4c-4739-9a83-61427adf2f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1667689115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12834d4d-d00a-46bf-a4f0-1c0cd6bba37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7082746f172465dbd216351663efbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:42Z,use_quota=True,user_id='b1fef4989255465cabf4c7e5071623b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe3906e-16fd-4f28-8f12-3f716d9fddf0),volume_type_id=ffe3906e-16fd-4f28-8f12-3f716d9fddf0)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcd1b5b-3ebb-47a2-871b-20b2e06bc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcd1b5b-3ebb-47a2-871b-20b2e06bc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a0c52d-24da-4bbd-80ea-da668c464d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a0c52d-24da-4bbd-80ea-da668c464d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12834d4d-d00a-46bf-a4f0-1c0cd6bba37c', 'volume_name': 'volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d389c0dd-b352-4b3d-9db1-d6843977e3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d389c0dd-b352-4b3d-9db1-d6843977e3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ca1090-bcff-4ad2-bfb7-c2722f881b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume 12834d4d-d00a-46bf-a4f0-1c0cd6bba37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c', 'volume_size': 1} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:42 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf" returned: 0 in 0.481s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc770bd-896c-48cb-a8d8-f00b133ffb1b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Flow 'volume_create_manager' (dded11f3-96e9-4ffe-be11-aaebf772dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004e1cd-a831-42ec-8481-b9cc1eb01001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004e1cd-a831-42ec-8481-b9cc1eb01001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-243842819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca5cef0-5615-4f8b-a98c-adc523a207d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7082746f172465dbd216351663efbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:43Z,use_quota=True,user_id='b1fef4989255465cabf4c7e5071623b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597bccf4-d096-4127-8aba-4781f1f14623),volume_type_id=597bccf4-d096-4127-8aba-4781f1f14623)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb911f0a-64bf-489b-8128-cae98a7dbd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb911f0a-64bf-489b-8128-cae98a7dbd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d09063-7ac3-435d-9f41-848c15f56bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d09063-7ac3-435d-9f41-848c15f56bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca5cef0-5615-4f8b-a98c-adc523a207d7', 'volume_name': 'volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928c91a5-ef78-4c22-8dd9-3b459919d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928c91a5-ef78-4c22-8dd9-3b459919d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:42 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541fefbb-a03a-4df7-a0f1-dddade13cbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume 0ca5cef0-5615-4f8b-a98c-adc523a207d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7', 'volume_size': 1} Sep 28 16:10:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:43 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" returned: 0 in 0.561s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:43 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 Sep 28 16:10:43 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Flow 'volume_create_manager' (c0860383-bf29-4c4f-997f-e7ce3108c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab8d3a3-77a8-473a-b05f-7f54cc37ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab8d3a3-77a8-473a-b05f-7f54cc37ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-225920645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143ff996-75e1-4aa9-a2a7-4152456d9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7082746f172465dbd216351663efbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:44Z,use_quota=True,user_id='b1fef4989255465cabf4c7e5071623b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(645e1039-8352-4976-a24a-cf0412e3ef04),volume_type_id=645e1039-8352-4976-a24a-cf0412e3ef04)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53d692a-bc07-4c72-aae6-37dda9c9b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53d692a-bc07-4c72-aae6-37dda9c9b08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6691bd37-baaf-4ffb-b6c7-8e2095a6812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:10:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-7d752d47-81a0-4c22-8583-a5a16e60caf0 req-7eeebffb-074e-4a52-87ff-dfd696deedc0 tempest-TestStampPattern-1221211916 None] Terminate volume connection completed successfully. Sep 28 16:10:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-7d752d47-81a0-4c22-8583-a5a16e60caf0 req-7eeebffb-074e-4a52-87ff-dfd696deedc0 tempest-TestStampPattern-1221211916 None] Deleting attachment a473686d-fdb0-4609-81d4-2a07b14ffa2d. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:10:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6691bd37-baaf-4ffb-b6c7-8e2095a6812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '143ff996-75e1-4aa9-a2a7-4152456d9856', 'volume_name': 'volume-143ff996-75e1-4aa9-a2a7-4152456d9856', 'volume_size': 1, 'image_id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf007964-c956-4a2f-87f9-5d07aef3d792', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1804000354', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7082746f172465dbd216351663efbc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'created_at': datetime.datetime(2026, 9, 28, 14, 10, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 10, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf007964-c956-4a2f-87f9-5d07aef3d792/file', 'properties': {}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6a54d5-a83d-4e6f-aecd-7b76c66c69a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6a54d5-a83d-4e6f-aecd-7b76c66c69a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f89549-7bb2-4bc3-b5a1-dac20385a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:44 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume 143ff996-75e1-4aa9-a2a7-4152456d9856: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-143ff996-75e1-4aa9-a2a7-4152456d9856', 'volume_size': 1, 'image_id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf007964-c956-4a2f-87f9-5d07aef3d792', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1804000354', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7082746f172465dbd216351663efbc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'created_at': datetime.datetime(2026, 9, 28, 14, 10, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 10, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf007964-c956-4a2f-87f9-5d07aef3d792/file', 'properties': {}}, 'image_service': } Sep 28 16:10:44 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Trying to clone 143ff996-75e1-4aa9-a2a7-4152456d9856 from image bf007964-c956-4a2f-87f9-5d07aef3d792 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf007964-c956-4a2f-87f9-5d07aef3d792', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:10:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:49 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Flow 'volume_create_manager' (4bc28a65-7add-4c17-b307-1247f970777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21248d7-f625-4c0a-a97d-74f9299e2d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21248d7-f625-4c0a-a97d-74f9299e2d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1006304172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a683cc-6681-4173-9eb1-5fcc88ad1a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd681362d3494096113fa943fcfb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:50Z,use_quota=True,user_id='8f6286b6b5eb4512a547511a4b6ee184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f816df-b4a2-4281-980a-11550e8332a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f816df-b4a2-4281-980a-11550e8332a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49281581-de3a-42dc-a8fe-6af50ec2f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49281581-de3a-42dc-a8fe-6af50ec2f62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a683cc-6681-4173-9eb1-5fcc88ad1a5c', 'volume_name': 'volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01e1276-3fa1-45ea-997f-62a7cfbee65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01e1276-3fa1-45ea-997f-62a7cfbee65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c31c34b-eedc-4154-8e0f-8cf5ea8c4595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Volume 46a683cc-6681-4173-9eb1-5fcc88ad1a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c', 'volume_size': 1} Sep 28 16:10:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:52 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD, size 20.69 MB, duration 8.52 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:10:52 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Image download 20.69 MB at 2.43 MB/s Sep 28 16:10:52 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7f9ba-6375-4ccd-b14e-6891de4072ee]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD Sep 28 16:10:53 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570" returned: 0 in 10.151s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2, size 1024.00 MB, duration 10.15 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:10:53 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Converted 1024.00 MB image at 100.86 MB/s Sep 28 16:10:53 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 is being set with open permissions: ugo+rw Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Temporary image bf007964-c956-4a2f-87f9-5d07aef3d792 is fetched for user b1fef4989255465cabf4c7e5071623b6. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:10:53 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 Sep 28 16:10:53 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62d7d65-c6b3-4cb4-bcd8-b5fd64c6fbed]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD Sep 28 16:10:53 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570" returned: 0 in 0.339s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-7ec6c010-e662-482f-a88b-72a182b08570" released by "_copy_volume_from_snapshot" :: held 11.680s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-e9b33502-bffe-4ee6-8482-6047d5307caf-7ec6c010-e662-482f-a88b-72a182b08570" released by "_create_volume_from_snapshot" :: held 11.775s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.803s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.510s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1667689115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12834d4d-d00a-46bf-a4f0-1c0cd6bba37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7082746f172465dbd216351663efbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:42Z,use_quota=True,user_id='b1fef4989255465cabf4c7e5071623b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe3906e-16fd-4f28-8f12-3f716d9fddf0),volume_type_id=ffe3906e-16fd-4f28-8f12-3f716d9fddf0)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Creating volume 12834d4d-d00a-46bf-a4f0-1c0cd6bba37c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:53 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c 1073741824 Sep 28 16:10:53 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8ee7f-645d-46ec-a565-5c8012fce738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec6c010-e662-482f-a88b-72a182b08570', 'volume_size': 1, 'snapshot_id': 'e9b33502-bffe-4ee6-8482-6047d5307caf'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860b6280-63ef-47e6-b812-3f49e3523e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:53 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Volume volume-7ec6c010-e662-482f-a88b-72a182b08570 (7ec6c010-e662-482f-a88b-72a182b08570): created successfully Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860b6280-63ef-47e6-b812-3f49e3523e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Flow 'volume_create_manager' (9b22171b-7dc2-4e54-94a5-77fd107bed78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:53 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-88a67124-a4f0-4d8a-8870-9f1512243413 tempest-VolumeDependencyTests-853515879 None] Created volume successfully. Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:54 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c 1073741824" returned: 0 in 0.585s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:54 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c Sep 28 16:10:54 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-e9b33502-bffe-4ee6-8482-6047d5307caf-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Lock "cinder-e9b33502-bffe-4ee6-8482-6047d5307caf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-quobyte-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-quobyte-e9b33502-bffe-4ee6-8482-6047d5307caf" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-e9b33502-bffe-4ee6-8482-6047d5307caf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Deleting offline snapshot e9b33502-bffe-4ee6-8482-6047d5307caf of volume f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] snapshot_file for this snap is: volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd47719-9bbc-41f3-85d4-e69fae204874]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:54 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c" returned: 0 in 0.380s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.035s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-243842819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca5cef0-5615-4f8b-a98c-adc523a207d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7082746f172465dbd216351663efbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:43Z,use_quota=True,user_id='b1fef4989255465cabf4c7e5071623b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597bccf4-d096-4127-8aba-4781f1f14623),volume_type_id=597bccf4-d096-4127-8aba-4781f1f14623)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Creating volume 0ca5cef0-5615-4f8b-a98c-adc523a207d7 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:54 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ca1090-bcff-4ad2-bfb7-c2722f881b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb40624-9b51-4231-83bd-406c41f8af66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:54 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 1073741824 Sep 28 16:10:54 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c (12834d4d-d00a-46bf-a4f0-1c0cd6bba37c): created successfully Sep 28 16:10:54 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf Sep 28 16:10:54 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb40624-9b51-4231-83bd-406c41f8af66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Flow 'volume_create_manager' (a7fa8d91-fa0d-49f1-8eed-06b4dd5f5026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-67bacfef-086c-4028-9b17-a67e3cb23531 tempest-TestInstancesWithCinderVolumes-603105403 None] Created volume successfully. Sep 28 16:10:55 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf" returned: 0 in 0.571s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6976879-ea6e-496f-89a0-d21777e2b0c2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:55 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 Sep 28 16:10:55 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:55 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 1073741824" returned: 0 in 0.684s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:55 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 Sep 28 16:10:55 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:55 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7" returned: 0 in 0.356s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.739s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541fefbb-a03a-4df7-a0f1-dddade13cbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71091e5-a38c-4780-b5a8-fa0336ef4b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Creating offline snapshot 471c42d2-7b09-4299-b7f4-287947764d0f of volume c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 (0ca5cef0-5615-4f8b-a98c-adc523a207d7): created successfully Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71091e5-a38c-4780-b5a8-fa0336ef4b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Flow 'volume_create_manager' (dded11f3-96e9-4ffe-be11-aaebf772dd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661fe0b-225b-42b0-91ce-fbfbf6857693]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-273066ba-c38d-4cd5-a68d-16e5903dddb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Created volume successfully. Sep 28 16:10:56 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" returned: 0 in 0.772s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:56 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf Sep 28 16:10:56 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:56 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd Sep 28 16:10:56 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:56 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" returned: 0 in 0.490s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:56 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f 1G Sep 28 16:10:56 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:56 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf" returned: 0 in 0.464s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:56 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf Sep 28 16:10:56 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:56 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2.e9b33502-bffe-4ee6-8482-6047d5307caf" returned: 0 in 0.336s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-e9b33502-bffe-4ee6-8482-6047d5307caf" released by "_delete_snapshot" :: held 2.294s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" released by "delete_snapshot" :: held 2.320s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:57 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f 1G" returned: 0 in 0.504s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:57 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f Sep 28 16:10:57 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Created reservations ['4ffdd763-1c2f-4df6-83da-d659b67e0ef5', '76471c7f-1190-45c6-b89f-56a910766d84', 'a05bf1e7-3360-4876-958b-70c705417c45', '2abd2fd7-1a1c-4360-a780-694f55c1bfa2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Delete snapshot completed successfully. Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-79466bc0-4fbc-4346-91e3-fc6dbbdaa01b tempest-VolumeDependencyTests-853515879 None] Lock "cinder-e9b33502-bffe-4ee6-8482-6047d5307caf-delete_snapshot" released by "delete_snapshot" :: held 2.535s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:57 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f" returned: 0 in 0.395s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:57 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f is being set with open permissions: ugo+rw Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:57 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f Sep 28 16:10:57 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:57 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f" returned: 0 in 0.356s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:57 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info Sep 28 16:10:57 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Lock "cinder-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-quobyte-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" acquired by "delete_volume" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f69c22-4480-48b7-af9a-13f8a3e63e82]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:58 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info" returned: 0 in 0.364s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:58 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info is being set with open permissions: ugo+rw Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:58 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info Sep 28 16:10:58 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 Sep 28 16:10:58 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.info" returned: 0 in 0.348s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.506s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1006304172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a683cc-6681-4173-9eb1-5fcc88ad1a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd681362d3494096113fa943fcfb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:50Z,use_quota=True,user_id='8f6286b6b5eb4512a547511a4b6ee184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Creating volume 46a683cc-6681-4173-9eb1-5fcc88ad1a5c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:58 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" returned: 0 in 0.534s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:58 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c 1073741824 Sep 28 16:10:58 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2 Sep 28 16:10:58 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-224ca0bf-f11c-409f-8175-11a2042a3c37 tempest-TestStampPattern-1221211916 None] Create snapshot completed successfully Sep 28 16:10:58 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" returned: 0 in 0.337s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2" released by "delete_volume" :: held 0.974s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Created reservations ['63511999-3853-47ba-ad96-e61664060c55', '59b7a9ea-12bf-48d0-a18c-f33ae346fac5', 'b8b0567a-04d9-4c50-826c-6dee4a66b1a5', 'bf688346-3ebe-476e-86ae-22fbb4ce465d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:59 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:10:59 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:59 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c 1073741824" returned: 0 in 0.663s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:59 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c Sep 28 16:10:59 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:59 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.369s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Deleted volume successfully. Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f28dc5b9-4741-4d15-a565-e002b3f3616a tempest-VolumeDependencyTests-853515879 None] Lock "cinder-f62c4aa3-32a1-4d46-b054-fa4c0f8093d2-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:59 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c" returned: 0 in 0.344s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.738s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-225920645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143ff996-75e1-4aa9-a2a7-4152456d9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7082746f172465dbd216351663efbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:44Z,use_quota=True,user_id='b1fef4989255465cabf4c7e5071623b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(645e1039-8352-4976-a24a-cf0412e3ef04),volume_type_id=645e1039-8352-4976-a24a-cf0412e3ef04)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Creating volume 143ff996-75e1-4aa9-a2a7-4152456d9856 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:59 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c31c34b-eedc-4154-8e0f-8cf5ea8c4595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:59 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 1073741824 Sep 28 16:10:59 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e356e748-b186-4991-9463-6264af906c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Volume volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c (46a683cc-6681-4173-9eb1-5fcc88ad1a5c): created successfully Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e356e748-b186-4991-9463-6264af906c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Flow 'volume_create_manager' (4bc28a65-7add-4c17-b307-1247f970777e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-27f25098-3ba9-4902-b25f-3e39359aeedf tempest-AttachVolumeNegativeTest-1745245844 None] Created volume successfully. Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-7ec6c010-e662-482f-a88b-72a182b08570-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-7ec6c010-e662-482f-a88b-72a182b08570-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:00 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "cinder-quobyte-7ec6c010-e662-482f-a88b-72a182b08570" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 1073741824" returned: 0 in 0.725s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-7ec6c010-e662-482f-a88b-72a182b08570" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d99158-44fe-4b27-8f46-715bca388059]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:00 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 Sep 28 16:11:00 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:00 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 Sep 28 16:11:00 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856" returned: 0 in 0.480s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Attempting download of bf007964-c956-4a2f-87f9-5d07aef3d792 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf007964-c956-4a2f-87f9-5d07aef3d792', 'metadata': {}}])) to volume 143ff996-75e1-4aa9-a2a7-4152456d9856. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:11:01 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570" returned: 0 in 0.629s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f62e678-dcea-4362-b03e-f28c61f39622]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:01 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570 Sep 28 16:11:01 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb Sep 28 16:11:01 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7ec6c010-e662-482f-a88b-72a182b08570" returned: 0 in 0.543s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-quobyte-7ec6c010-e662-482f-a88b-72a182b08570" released by "delete_volume" :: held 1.249s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:01 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb" returned: 0 in 0.613s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Created reservations ['68c691fc-eb1c-494e-ac4d-27cc4d90da2b', '57d10b6e-a3cc-492f-936c-1d6d145bd1a5', '50deb8d8-e694-4938-ac32-3e36ba370d9f', '2fa81e8e-b865-4039-b3d8-9757a38f5ae8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:01 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb Sep 28 16:11:01 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:02 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:11:02 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-9bc00033-89e3-45b1-89c4-f15fedebb26e req-7035a29d-f731-44cc-ac7f-d78d7c282b99 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-9bc00033-89e3-45b1-89c4-f15fedebb26e req-7035a29d-f731-44cc-ac7f-d78d7c282b99 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-9bc00033-89e3-45b1-89c4-f15fedebb26e req-7035a29d-f731-44cc-ac7f-d78d7c282b99 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-9bc00033-89e3-45b1-89c4-f15fedebb26e req-7035a29d-f731-44cc-ac7f-d78d7c282b99 tempest-AttachVolumeNegativeTest-1745245844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8e68d12-7969-4104-8f4c-603ecd61e230', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:11:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-9bc00033-89e3-45b1-89c4-f15fedebb26e req-7035a29d-f731-44cc-ac7f-d78d7c282b99 tempest-AttachVolumeNegativeTest-1745245844 None] attachment_update completed successfully. Sep 28 16:11:02 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb" returned: 1 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf007964-c956-4a2f-87f9-5d07aef3d792_76dytgjb' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a874f7-f84b-45cd-b2e7-2e6f94f45e09]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:02 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.385s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Deleted volume successfully. Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea6d7bba-85ab-4032-87cd-4800fd540b85 tempest-VolumeDependencyTests-853515879 None] Lock "cinder-7ec6c010-e662-482f-a88b-72a182b08570-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:02 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD Sep 28 16:11:02 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:02 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] bf007964-c956-4a2f-87f9-5d07aef3d792 was qcow2, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:11:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:02 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 Sep 28 16:11:02 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-9c0d03ad-92a0-44c0-a3e0-038b3065ce35 req-ae56904e-8069-418f-b875-6e05ac77e667 tempest-AttachVolumeNegativeTest-1745245844 None] Terminate volume connection completed successfully. Sep 28 16:11:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-9c0d03ad-92a0-44c0-a3e0-038b3065ce35 req-ae56904e-8069-418f-b875-6e05ac77e667 tempest-AttachVolumeNegativeTest-1745245844 None] Deleting attachment f8e68d12-7969-4104-8f4c-603ecd61e230. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:11:06 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856" returned: 0 in 3.352s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:06 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf007964-c956-4a2f-87f9-5d07aef3d792_xjg8x7f7devstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:11:06 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Converted 112.00 MB image at 33.40 MB/s Sep 28 16:11:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:06 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 1G Sep 28 16:11:06 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:07 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 1G" returned: 0 in 0.847s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Downloaded image bf007964-c956-4a2f-87f9-5d07aef3d792 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf007964-c956-4a2f-87f9-5d07aef3d792', 'metadata': {}}])) to volume 143ff996-75e1-4aa9-a2a7-4152456d9856 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Temporary image bf007964-c956-4a2f-87f9-5d07aef3d792 for user b1fef4989255465cabf4c7e5071623b6 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Marking volume 143ff996-75e1-4aa9-a2a7-4152456d9856 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Copying metadata from image bf007964-c956-4a2f-87f9-5d07aef3d792 to 143ff996-75e1-4aa9-a2a7-4152456d9856. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Creating volume glance metadata for volume 143ff996-75e1-4aa9-a2a7-4152456d9856 backed by image bf007964-c956-4a2f-87f9-5d07aef3d792 with: {'image_id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'image_name': 'tempest-scenario-img--1804000354', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f89549-7bb2-4bc3-b5a1-dac20385a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143ff996-75e1-4aa9-a2a7-4152456d9856', 'volume_size': 1, 'image_id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf007964-c956-4a2f-87f9-5d07aef3d792', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1804000354', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7082746f172465dbd216351663efbc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf007964-c956-4a2f-87f9-5d07aef3d792', 'created_at': datetime.datetime(2026, 9, 28, 14, 10, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 10, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf007964-c956-4a2f-87f9-5d07aef3d792/file', 'properties': {}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e52d637-86a4-4fea-97a1-9e4a998a20d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Volume volume-143ff996-75e1-4aa9-a2a7-4152456d9856 (143ff996-75e1-4aa9-a2a7-4152456d9856): created successfully Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e52d637-86a4-4fea-97a1-9e4a998a20d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Flow 'volume_create_manager' (c0860383-bf29-4c4f-997f-e7ce3108c912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7390df41-3974-474a-b056-c99495fba055 tempest-TestInstancesWithCinderVolumes-603105403 None] Created volume successfully. Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Flow 'volume_create_manager' (6e9ac595-ef8a-4a73-a4ff-b7c2fbf92e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf2f57c-eb7f-4b29-9039-3b4d23f09996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf2f57c-eb7f-4b29-9039-3b4d23f09996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-355129799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829ccdcc81c4d73a45574ec03e57880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=471c42d2-7b09-4299-b7f4-287947764d0f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:11Z,use_quota=True,user_id='580d4cce120b4435a624e6c03982bcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e626dfa1-c067-4c94-933b-8acafdd697aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e626dfa1-c067-4c94-933b-8acafdd697aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca6c4fd-3f32-4ee7-a9a3-d7703aaede02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca6c4fd-3f32-4ee7-a9a3-d7703aaede02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22', 'volume_name': 'volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22', 'volume_size': 1, 'snapshot_id': '471c42d2-7b09-4299-b7f4-287947764d0f'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ceb092-63a1-4863-a24d-b9069b14a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ceb092-63a1-4863-a24d-b9069b14a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3c96a7-95ec-4dc6-8476-d46ecf3cdcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Volume cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22', 'volume_size': 1, 'snapshot_id': '471c42d2-7b09-4299-b7f4-287947764d0f'} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-quobyte-471c42d2-7b09-4299-b7f4-287947764d0f-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-471c42d2-7b09-4299-b7f4-287947764d0f-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Creating volume cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 from snapshot 471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-quobyte-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] snapshot: 471c42d2-7b09-4299-b7f4-287947764d0f, volume: cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbfed23-ecbd-4405-b268-447351822880]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:12 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f Sep 28 16:11:12 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:12 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f" returned: 0 in 0.817s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[491ae1d3-addc-4349-9ea1-f70121f2e7d6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:13 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd Sep 28 16:11:13 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "cinder-46a683cc-6681-4173-9eb1-5fcc88ad1a5c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-46a683cc-6681-4173-9eb1-5fcc88ad1a5c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "cinder-quobyte-46a683cc-6681-4173-9eb1-5fcc88ad1a5c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-quobyte-46a683cc-6681-4173-9eb1-5fcc88ad1a5c" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[65377248-b19d-4f08-a1fe-cf8e1d293473]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:13 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" returned: 0 in 0.881s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:11:13 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:11:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:13 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:13 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 Sep 28 16:11:13 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:14 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c" returned: 0 in 0.754s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:14 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c Sep 28 16:11:14 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-df667c4a-cdad-4371-bded-2e060a501116 req-3827f3f8-f1c8-4208-af47-2537c9f5b170 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:15 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46a683cc-6681-4173-9eb1-5fcc88ad1a5c" returned: 0 in 0.752s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-quobyte-46a683cc-6681-4173-9eb1-5fcc88ad1a5c" released by "delete_volume" :: held 1.605s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Created reservations ['f093a67c-4174-4afc-87e7-b77ad7fc738c', '48efa25d-847d-41db-8572-0cf050432120', 'd438ff98-72c8-4fb6-8d37-e8bc6dfd5fcf', 'fd97cd25-71ac-4ed4-84e2-537e18ab27b3'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:15 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:11:15 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "cinder-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "cinder-quobyte-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-quobyte-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e" acquired by "delete_volume" :: waited 0.044s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a2ebab-f81b-452c-949f-ddd989cc850c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:17 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 1.593s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:17 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Deleted volume successfully. Sep 28 16:11:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ace4ff23-9e1e-488e-a5c7-fe88013d800b tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-46a683cc-6681-4173-9eb1-5fcc88ad1a5c-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:17 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e Sep 28 16:11:17 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:18 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e" returned: 0 in 1.597s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:18 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e Sep 28 16:11:18 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:19 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e" returned: 0 in 1.093s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-quobyte-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e" released by "delete_volume" :: held 2.893s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Created reservations ['5723ddf1-2078-4163-bb1e-b0bcc05ac81c', '1d659a88-36a8-411a-bca2-b87283f09b8d', '8c2a2d00-e6b8-4ac0-96c1-45527c618923', '100a3ef2-8c5d-436e-87c0-d8ff57f43921'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:20 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:11:20 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:21 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.804s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:21 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:21 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Deleted volume successfully. Sep 28 16:11:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e0b91a28-d9e0-4088-a92c-dbb215dbd480 tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-fdbc9877-fddc-4b0e-b8cf-d4aeeeef698e-delete_volume" released by "delete_volume" :: held 4.577s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "cinder-1cde681f-032f-4708-b858-b1c24c2855cc-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-1cde681f-032f-4708-b858-b1c24c2855cc-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=67,cinder:INSERT=17,cinder:UPDATE=64,cinder:DELETE=6 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=82,cinder:INSERT=24,cinder:UPDATE=79,cinder:DELETE=7 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "cinder-quobyte-1cde681f-032f-4708-b858-b1c24c2855cc" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-quobyte-1cde681f-032f-4708-b858-b1c24c2855cc" acquired by "delete_volume" :: waited 0.052s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e085884-f593-4b0e-a7f6-c88bb8b5e1e9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:26 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc Sep 28 16:11:26 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:26 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:11:26 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:26 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc" returned: 0 in 1.123s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:27 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc Sep 28 16:11:27 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:27 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.760s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:11:27 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" returned: 0 in 13.757s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd, size 1024.00 MB, duration 13.76 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:11:27 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Converted 1024.00 MB image at 74.42 MB/s Sep 28 16:11:27 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 is being set with open permissions: ugo+rw Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:27 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1cde681f-032f-4708-b858-b1c24c2855cc" returned: 0 in 0.656s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:27 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 Sep 28 16:11:27 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-quobyte-1cde681f-032f-4708-b858-b1c24c2855cc" released by "delete_volume" :: held 1.906s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Created reservations ['a83f3fbd-b5ed-4627-b997-860c1c1ff563', 'f2e0c297-12b9-4445-bc1a-d55c86bbeeb9', 'c2fe056f-6cd6-4f08-a993-03e96b384cf4', '8797544a-b8e6-440c-9a12-4c3ba15a0e67'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:27 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:11:27 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:28 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" returned: 0 in 0.577s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" released by "_copy_volume_from_snapshot" :: held 16.235s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-471c42d2-7b09-4299-b7f4-287947764d0f-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" released by "_create_volume_from_snapshot" :: held 16.409s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.453s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-df667c4a-cdad-4371-bded-2e060a501116 req-3827f3f8-f1c8-4208-af47-2537c9f5b170 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.202s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-df667c4a-cdad-4371-bded-2e060a501116 req-3827f3f8-f1c8-4208-af47-2537c9f5b170 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:28 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3c96a7-95ec-4dc6-8476-d46ecf3cdcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22', 'volume_size': 1, 'snapshot_id': '471c42d2-7b09-4299-b7f4-287947764d0f'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ee3024-a3af-45c6-9855-ea314a5220a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.615s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:28 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Volume volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 (cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22): created successfully Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ee3024-a3af-45c6-9855-ea314a5220a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Flow 'volume_create_manager' (6e9ac595-ef8a-4a73-a4ff-b7c2fbf92e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Deleted volume successfully. Sep 28 16:11:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-18ae49ba-a06a-4a59-9689-37426536e048 tempest-TestStampPattern-1221211916 None] Created volume successfully. Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5b76d2db-4b17-4716-a2c7-06c0527fb60e tempest-AttachVolumeNegativeTest-1745245844 None] Lock "cinder-1cde681f-032f-4708-b858-b1c24c2855cc-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:28 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-df667c4a-cdad-4371-bded-2e060a501116 req-3827f3f8-f1c8-4208-af47-2537c9f5b170 tempest-TestInstancesWithCinderVolumes-603105403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-143ff996-75e1-4aa9-a2a7-4152456d9856', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '608c203c-f91a-4677-8acb-f1d3f29f3801', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:11:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-df667c4a-cdad-4371-bded-2e060a501116 req-3827f3f8-f1c8-4208-af47-2537c9f5b170 tempest-TestInstancesWithCinderVolumes-603105403 None] attachment_update completed successfully. Sep 28 16:11:38 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:38 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-4118bb16-63a8-433f-ac53-b3cfc0647df9 tempest-BackendsCapabilitiesAdminTestsJSON-708623000 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1803398132324, 'free_capacity_gb': 1775.1803398132324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86628) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:11:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f79eebc6-cd93-40aa-b987-41f184633989 tempest-BackendsCapabilitiesAdminTestsJSON-708623000 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1803398132324, 'free_capacity_gb': 1775.1803398132324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86628) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:11:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-ef49faad-7c9a-41dd-a537-024c6f39b37c req-83dc0a6b-7e07-4f1d-9f6d-8ee0bac926a8 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-ef49faad-7c9a-41dd-a537-024c6f39b37c req-83dc0a6b-7e07-4f1d-9f6d-8ee0bac926a8 tempest-TestStampPattern-1221211916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-ef49faad-7c9a-41dd-a537-024c6f39b37c req-83dc0a6b-7e07-4f1d-9f6d-8ee0bac926a8 tempest-TestStampPattern-1221211916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-ef49faad-7c9a-41dd-a537-024c6f39b37c req-83dc0a6b-7e07-4f1d-9f6d-8ee0bac926a8 tempest-TestStampPattern-1221211916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '590779f2-22f3-4113-86eb-241afc1c8e61', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:12:09 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-ef49faad-7c9a-41dd-a537-024c6f39b37c req-83dc0a6b-7e07-4f1d-9f6d-8ee0bac926a8 tempest-TestStampPattern-1221211916 None] attachment_update completed successfully. Sep 28 16:12:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-87fd4b90-5081-4aae-95d0-80709fb53336 req-c58cae87-e0fe-4fc3-b7cd-3080377d5e30 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-87fd4b90-5081-4aae-95d0-80709fb53336 req-c58cae87-e0fe-4fc3-b7cd-3080377d5e30 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-87fd4b90-5081-4aae-95d0-80709fb53336 req-c58cae87-e0fe-4fc3-b7cd-3080377d5e30 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-87fd4b90-5081-4aae-95d0-80709fb53336 req-c58cae87-e0fe-4fc3-b7cd-3080377d5e30 tempest-TestInstancesWithCinderVolumes-603105403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2020f99-9654-4754-a744-610c600be5c5', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:12:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-87fd4b90-5081-4aae-95d0-80709fb53336 req-c58cae87-e0fe-4fc3-b7cd-3080377d5e30 tempest-TestInstancesWithCinderVolumes-603105403 None] attachment_update completed successfully. Sep 28 16:12:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-2dcfe61f-408b-4aeb-aa0d-20bb23b82fca req-c3a2adbb-7f2e-4f62-acc9-8e8755cba564 tempest-TestStampPattern-1221211916 None] Terminate volume connection completed successfully. Sep 28 16:12:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-2dcfe61f-408b-4aeb-aa0d-20bb23b82fca req-c3a2adbb-7f2e-4f62-acc9-8e8755cba564 tempest-TestStampPattern-1221211916 None] Deleting attachment 590779f2-22f3-4113-86eb-241afc1c8e61. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:12:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-2429a7c9-69d5-4b99-a6cf-db9e583af640 req-1ae239b1-47e0-450f-8bdc-9abdc6d3f039 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-2429a7c9-69d5-4b99-a6cf-db9e583af640 req-1ae239b1-47e0-450f-8bdc-9abdc6d3f039 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-2429a7c9-69d5-4b99-a6cf-db9e583af640 req-1ae239b1-47e0-450f-8bdc-9abdc6d3f039 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-2429a7c9-69d5-4b99-a6cf-db9e583af640 req-1ae239b1-47e0-450f-8bdc-9abdc6d3f039 tempest-TestInstancesWithCinderVolumes-603105403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d52a402-2320-4323-8b8e-c710947bd286', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:12:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-2429a7c9-69d5-4b99-a6cf-db9e583af640 req-1ae239b1-47e0-450f-8bdc-9abdc6d3f039 tempest-TestInstancesWithCinderVolumes-603105403 None] attachment_update completed successfully. Sep 28 16:12:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Lock "cinder-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-quobyte-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3674bf-5864-49e0-b179-9ca1a6da1a68]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:19 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 Sep 28 16:12:19 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:19 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" returned: 0 in 0.491s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:19 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22 Sep 28 16:12:19 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:19 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" returned: 0 in 0.313s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22" released by "delete_volume" :: held 0.862s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:19 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Created reservations ['28fe2835-563f-48f8-b3e2-10b0c0a8ee3e', '0d860171-8551-45a8-b5e4-55aeda4c86c9', '45224c37-6cb6-447e-994c-ced0b2a44283', 'a2789f6d-cf93-4567-9708-2e47cf138af0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:20 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:20 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:20 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.399s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Deleted volume successfully. Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4c32c811-33eb-4d65-adae-35da78a9fae2 tempest-TestStampPattern-1221211916 None] Lock "cinder-cad0d2ff-b0c1-42e8-bdfa-b4e908df0c22-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-471c42d2-7b09-4299-b7f4-287947764d0f-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Lock "cinder-471c42d2-7b09-4299-b7f4-287947764d0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-quobyte-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-quobyte-471c42d2-7b09-4299-b7f4-287947764d0f" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-471c42d2-7b09-4299-b7f4-287947764d0f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Deleting offline snapshot 471c42d2-7b09-4299-b7f4-287947764d0f of volume c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] snapshot_file for this snap is: volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e716692-4924-4276-a9c8-2b2c7d398238]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:20 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f Sep 28 16:12:20 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:21 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f" returned: 0 in 0.464s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:21 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b9d42-f904-4168-bfff-b7e689d1fb1b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:21 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd Sep 28 16:12:21 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:22 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" returned: 0 in 0.734s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:22 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f Sep 28 16:12:22 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:22 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f" returned: 0 in 0.429s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:22 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f Sep 28 16:12:22 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:22 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd.471c42d2-7b09-4299-b7f4-287947764d0f" returned: 0 in 0.320s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-471c42d2-7b09-4299-b7f4-287947764d0f" released by "_delete_snapshot" :: held 2.094s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" released by "delete_snapshot" :: held 2.138s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:22 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Created reservations ['d48b134b-b491-4aed-b5b2-5dd3d2460f2a', '80e913b9-e3be-4cc4-a0bd-cc336d59ae10', '720fd3bb-33c5-43f3-8bda-7c2ec2933493', '13563c7c-3453-4ff1-88a8-35372c70fd0e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Delete snapshot completed successfully. Sep 28 16:12:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4fff9e85-7abd-4a3a-8720-2178eea83e3c tempest-TestStampPattern-1221211916 None] Lock "cinder-471c42d2-7b09-4299-b7f4-287947764d0f-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-fd05319c-0345-4f93-88ac-13d33206867a req-9dc14e8f-9d0d-4279-a81d-dd1b6d74db99 tempest-TestInstancesWithCinderVolumes-603105403 None] Terminate volume connection completed successfully. Sep 28 16:12:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-fd05319c-0345-4f93-88ac-13d33206867a req-9dc14e8f-9d0d-4279-a81d-dd1b6d74db99 tempest-TestInstancesWithCinderVolumes-603105403 None] Deleting attachment e2020f99-9654-4754-a744-610c600be5c5. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "cinder-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "cinder-quobyte-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-quobyte-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c" acquired by "delete_volume" :: waited 0.060s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[17015f40-19be-42a2-94df-662a7df27adf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:26 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c Sep 28 16:12:26 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:26 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:26 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:27 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c" returned: 0 in 0.627s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:27 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c Sep 28 16:12:27 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:27 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.622s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:12:27 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c" returned: 0 in 0.535s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-quobyte-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c" released by "delete_volume" :: held 1.297s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:27 devstack cinder-volume[86628]: WARNING cinder.quota [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-382112984-1610850575 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-382112984-1610850575, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:27 devstack cinder-volume[86628]: WARNING cinder.quota [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-382112984-1610850575 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-382112984-1610850575, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Created reservations ['45d63748-8ae7-4265-80c8-1eb22fa6a05f', 'fe5cc4ab-2311-4260-904e-151fe13ed1f3', '1d386c71-0053-4eb1-845e-258e7b240a43', 'af38f31f-994c-4aca-b26c-5dffa3e0a203'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:28 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:28 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:28 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.508s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:28 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Deleted volume successfully. Sep 28 16:12:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fc2d7745-b4c3-4783-94cd-c4718ab7bf60 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-12834d4d-d00a-46bf-a4f0-1c0cd6bba37c-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-c011df2a-8906-40e0-bedc-d47fdb0cf2cd-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Lock "cinder-c011df2a-8906-40e0-bedc-d47fdb0cf2cd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Acquiring lock "cinder-quobyte-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4535dd-566a-4499-923f-1998cd523433]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:29 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd Sep 28 16:12:29 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:30 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" returned: 0 in 0.602s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:30 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd Sep 28 16:12:30 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:30 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" returned: 0 in 0.391s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Lock "cinder-quobyte-c011df2a-8906-40e0-bedc-d47fdb0cf2cd" released by "delete_volume" :: held 1.089s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Created reservations ['821d10b7-647e-42c5-b259-3627c00b5bc3', 'a0d00ddb-78b1-4f30-9b86-5e7c1774f14f', '2f10d7a7-6378-4f35-9457-02ff4d34b40a', '86c0d697-1ecd-4c70-959f-4cd65d694512'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:31 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:31 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:31 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:31 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Deleted volume successfully. Sep 28 16:12:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd6419a0-29ce-4b6c-8cda-d25ccfef50a4 tempest-TestStampPattern-1221211916 None] Lock "cinder-c011df2a-8906-40e0-bedc-d47fdb0cf2cd-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-c78a7703-8338-400b-8fc9-a4ce4bf29d43 req-7a0a32ca-7fc1-42a6-8f1c-8d288b484b6e tempest-TestInstancesWithCinderVolumes-603105403 None] Terminate volume connection completed successfully. Sep 28 16:12:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-c78a7703-8338-400b-8fc9-a4ce4bf29d43 req-7a0a32ca-7fc1-42a6-8f1c-8d288b484b6e tempest-TestInstancesWithCinderVolumes-603105403 None] Deleting attachment 8d52a402-2320-4323-8b8e-c710947bd286. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "cinder-0ca5cef0-5615-4f8b-a98c-adc523a207d7-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-0ca5cef0-5615-4f8b-a98c-adc523a207d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "cinder-quobyte-0ca5cef0-5615-4f8b-a98c-adc523a207d7" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-quobyte-0ca5cef0-5615-4f8b-a98c-adc523a207d7" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d8b831-e4d8-4aca-9165-2b4f72d0138e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:33 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 Sep 28 16:12:33 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:33 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7" returned: 0 in 0.561s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:33 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7 Sep 28 16:12:33 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:34 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0ca5cef0-5615-4f8b-a98c-adc523a207d7" returned: 0 in 0.458s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-quobyte-0ca5cef0-5615-4f8b-a98c-adc523a207d7" released by "delete_volume" :: held 1.099s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:34 devstack cinder-volume[86628]: WARNING cinder.quota [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869594370-2049004404 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869594370-2049004404, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:34 devstack cinder-volume[86628]: WARNING cinder.quota [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869594370-2049004404 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869594370-2049004404, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Created reservations ['31e52841-0877-4b76-ba43-e3c6980a909a', '7f31790d-a73a-4945-921c-ec81e0a502e3', '5c55f1aa-07e1-4cc3-ae34-ead6a2d2c371', 'f461089a-0ab5-4b5a-9483-1af669a96fe6'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:34 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:34 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:34 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.493s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:34 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Deleted volume successfully. Sep 28 16:12:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-da5e2d77-ad84-4a28-8f6c-a9020b5ba186 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-0ca5cef0-5615-4f8b-a98c-adc523a207d7-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-4254771b-6356-433b-ae1f-127e2efeedaa req-b5620007-6c32-46fc-b5e6-9bac6de87354 tempest-TestInstancesWithCinderVolumes-603105403 None] Terminate volume connection completed successfully. Sep 28 16:12:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-4254771b-6356-433b-ae1f-127e2efeedaa req-b5620007-6c32-46fc-b5e6-9bac6de87354 tempest-TestInstancesWithCinderVolumes-603105403 None] Deleting attachment 608c203c-f91a-4677-8acb-f1d3f29f3801. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:12:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "cinder-143ff996-75e1-4aa9-a2a7-4152456d9856-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-143ff996-75e1-4aa9-a2a7-4152456d9856-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "cinder-quobyte-143ff996-75e1-4aa9-a2a7-4152456d9856" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-quobyte-143ff996-75e1-4aa9-a2a7-4152456d9856" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:41 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7296a9d7-4fbd-44ba-a969-76968e712d5f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:41 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 Sep 28 16:12:41 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:42 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856" returned: 0 in 0.678s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:42 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856 Sep 28 16:12:42 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:42 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-143ff996-75e1-4aa9-a2a7-4152456d9856" returned: 0 in 0.444s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-quobyte-143ff996-75e1-4aa9-a2a7-4152456d9856" released by "delete_volume" :: held 1.209s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:42 devstack cinder-volume[86628]: WARNING cinder.quota [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755992668-1509296481 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755992668-1509296481, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:42 devstack cinder-volume[86628]: WARNING cinder.quota [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755992668-1509296481 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755992668-1509296481, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Created reservations ['248a90e7-bfbb-416a-8ab8-906632b396b1', '7f10d4cd-fa5c-4e5e-a527-2cdcf94d2e18', '2ebc854e-2307-4b36-b7d3-d878e7126f8a', 'eed390ef-32f9-4e09-baa7-aa45c6d5ac9f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:42 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:42 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:43 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.361s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:43 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Deleted volume successfully. Sep 28 16:12:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3e39656f-ba7b-429c-b920-aeda8bc3bfb4 tempest-TestInstancesWithCinderVolumes-603105403 None] Lock "cinder-143ff996-75e1-4aa9-a2a7-4152456d9856-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Flow 'volume_create_manager' (f1052c36-e90b-41f9-be8e-07e4950ebaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f8ab4a-e976-45ee-861e-34d0eaeb7f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f8ab4a-e976-45ee-861e-34d0eaeb7f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1443225919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8573c76-34fb-4f8e-9fe7-da08d0981b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d70015bebdc4a73b74e5011ba61fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:45Z,use_quota=True,user_id='b729b4f6ed5e4cf3b12787fe357868f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00fdd22-6d3a-4b41-93d4-8e0203e37dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00fdd22-6d3a-4b41-93d4-8e0203e37dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0471ac1-014d-4768-aeba-92c88fb25bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0471ac1-014d-4768-aeba-92c88fb25bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8573c76-34fb-4f8e-9fe7-da08d0981b4b', 'volume_name': 'volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c958cc88-d974-43e5-8c80-dbf77926f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c958cc88-d974-43e5-8c80-dbf77926f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5569e4b3-5188-43a8-90a3-85fd6e7e49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:44 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Volume d8573c76-34fb-4f8e-9fe7-da08d0981b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b', 'volume_size': 1} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1443225919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8573c76-34fb-4f8e-9fe7-da08d0981b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d70015bebdc4a73b74e5011ba61fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:45Z,use_quota=True,user_id='b729b4f6ed5e4cf3b12787fe357868f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Creating volume d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:44 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:12:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:44 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b 1073741824 Sep 28 16:12:44 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b 1073741824" returned: 0 in 0.651s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:45 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b Sep 28 16:12:45 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" returned: 0 in 0.417s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5569e4b3-5188-43a8-90a3-85fd6e7e49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1767e4c0-dd02-4c42-9bbf-918d5eb35ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:46 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Volume volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b (d8573c76-34fb-4f8e-9fe7-da08d0981b4b): created successfully Sep 28 16:12:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1767e4c0-dd02-4c42-9bbf-918d5eb35ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Flow 'volume_create_manager' (f1052c36-e90b-41f9-be8e-07e4950ebaaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:46 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-76c6aed3-d21d-41df-a21c-cb968c99713a tempest-SnapshotMetadataTestJSON-1277598190 None] Created volume successfully. Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Creating offline snapshot 1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee of volume d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf867c7-b694-4fe8-8c31-6146a7f7fca3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:47 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b Sep 28 16:12:47 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:47 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" returned: 0 in 0.515s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:47 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee 1G Sep 28 16:12:47 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee 1G" returned: 0 in 0.595s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee Sep 28 16:12:48 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" returned: 0 in 0.480s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee is being set with open permissions: ugo+rw Sep 28 16:12:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee Sep 28 16:12:49 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" returned: 0 in 0.366s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info Sep 28 16:12:49 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info" returned: 0 in 0.365s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info is being set with open permissions: ugo+rw Sep 28 16:12:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info Sep 28 16:12:49 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:50 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.info" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-dfba7fc2-1e11-4c1d-94c1-3f68fdffac75 tempest-SnapshotMetadataTestJSON-1277598190 None] Create snapshot completed successfully Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "cinder-1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "cinder-quobyte-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-quobyte-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "cinder-quobyte-1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-quobyte-1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Deleting offline snapshot 1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee of volume d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] snapshot_file for this snap is: volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2fd4a4-acbd-4791-997e-ef704fcf358a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:53 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee Sep 28 16:12:53 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:53 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" returned: 0 in 0.556s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9678c0-8ad8-417e-ab37-6cf2e640c747]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b Sep 28 16:12:54 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" returned: 0 in 0.569s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee Sep 28 16:12:54 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" returned: 0 in 0.526s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee Sep 28 16:12:55 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Flow 'volume_create_manager' (5a63470c-aec6-4bd4-9459-caf13a8028be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7094c4e3-b725-4e94-a325-ec9e50a755ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7094c4e3-b725-4e94-a325-ec9e50a755ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448711609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149b934b-436f-4c67-8689-154736bf816c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1628dec86fd4d89af4d5947c0860ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:55Z,use_quota=True,user_id='a591f764c5714d33bfaf588b35efb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c9e73d-749f-4efa-ad22-a67322513e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c9e73d-749f-4efa-ad22-a67322513e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043c717a-041f-4927-be4f-5bde0714c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043c717a-041f-4927-be4f-5bde0714c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149b934b-436f-4c67-8689-154736bf816c', 'volume_name': 'volume-149b934b-436f-4c67-8689-154736bf816c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b69b485-48c4-46d6-93d2-4a2a4644d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b69b485-48c4-46d6-93d2-4a2a4644d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537a23bd-1b1e-4986-855e-d8ca362b62ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:55 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Volume 149b934b-436f-4c67-8689-154736bf816c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149b934b-436f-4c67-8689-154736bf816c', 'volume_size': 1} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448711609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149b934b-436f-4c67-8689-154736bf816c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1628dec86fd4d89af4d5947c0860ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:55Z,use_quota=True,user_id='a591f764c5714d33bfaf588b35efb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Creating volume 149b934b-436f-4c67-8689-154736bf816c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:55 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b.1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c 1073741824 Sep 28 16:12:55 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-quobyte-1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee" released by "_delete_snapshot" :: held 2.209s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-quobyte-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" released by "delete_snapshot" :: held 2.253s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Created reservations ['b80fa4c5-75a2-42ae-bff0-220dec6616a0', 'f824b7a6-75cb-41c5-b42e-2ec0edf9e91f', '45e60aa9-9f8d-454c-8b27-523084343168', 'f07c24ee-61b9-43c3-bd34-a93d42aad46f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Delete snapshot completed successfully. Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bf8af748-0605-4dc0-a080-5ed4a3941d5a tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-1c73df2c-8ca7-4f78-9ac7-ecf5e35ce6ee-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:55 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c 1073741824" returned: 0 in 0.580s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c Sep 28 16:12:55 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c" returned: 0 in 0.309s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537a23bd-1b1e-4986-855e-d8ca362b62ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149b934b-436f-4c67-8689-154736bf816c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad6945a-1e06-494e-bd8a-2c06841d22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Volume volume-149b934b-436f-4c67-8689-154736bf816c (149b934b-436f-4c67-8689-154736bf816c): created successfully Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad6945a-1e06-494e-bd8a-2c06841d22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Flow 'volume_create_manager' (5a63470c-aec6-4bd4-9459-caf13a8028be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8cd6cc23-5e41-4c93-939e-2ca724bcd84c tempest-ProjectReaderTests-1347446559 None] Created volume successfully. Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "cinder-d8573c76-34fb-4f8e-9fe7-da08d0981b4b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-d8573c76-34fb-4f8e-9fe7-da08d0981b4b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "cinder-quobyte-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-quobyte-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f93863-c89b-42d6-956f-80624d0ff0f1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:56 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b Sep 28 16:12:56 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:57 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" returned: 0 in 0.591s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:57 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b Sep 28 16:12:57 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Acquiring lock "cinder-149b934b-436f-4c67-8689-154736bf816c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Lock "cinder-149b934b-436f-4c67-8689-154736bf816c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Acquiring lock "cinder-quobyte-149b934b-436f-4c67-8689-154736bf816c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Lock "cinder-quobyte-149b934b-436f-4c67-8689-154736bf816c" acquired by "delete_volume" :: waited 0.032s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:57 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a86b98d-20bb-46b8-8a6a-bc0b70197fde]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" returned: 0 in 0.466s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-quobyte-d8573c76-34fb-4f8e-9fe7-da08d0981b4b" released by "delete_volume" :: held 1.164s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Created reservations ['3d4af3a1-551d-4cd2-b15d-c54790e00f01', '935d8857-d7c8-44fe-b599-fb3431a090be', 'b111ae27-1072-4e04-974c-1779407e54e9', '6d59fcf1-cdcb-46c7-8b2d-db7a608e5ef4'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:57 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c Sep 28 16:12:57 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:57 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:57 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:58 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:58 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c Sep 28 16:12:58 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:58 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.470s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:58 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Deleted volume successfully. Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-52f134c0-7702-42ed-9102-3ce7393b5957 tempest-SnapshotMetadataTestJSON-1277598190 None] Lock "cinder-d8573c76-34fb-4f8e-9fe7-da08d0981b4b-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:58 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-149b934b-436f-4c67-8689-154736bf816c" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Lock "cinder-quobyte-149b934b-436f-4c67-8689-154736bf816c" released by "delete_volume" :: held 1.044s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Created reservations ['59e5b056-075c-4b28-8c73-a7296ea16f62', '408c9320-edad-42ea-aa49-538da536acca', '948fc690-6d5b-4c6c-b0b4-0cc86fc0a3fc', '111a79cf-c719-4ec7-b73d-87da47cd9d69'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:59 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:12:59 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.380s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:59 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Deleted volume successfully. Sep 28 16:12:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-806cfcb9-c84d-41ed-bbc3-a5064584d9c8 tempest-ProjectReaderTests-1347446559 None] Lock "cinder-149b934b-436f-4c67-8689-154736bf816c-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Flow 'volume_create_manager' (fbab66fd-64f1-44dd-9d6a-16fdbf076f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cf2ba4-6d74-489a-a548-a79e22be041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cf2ba4-6d74-489a-a548-a79e22be041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424525983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f99b48f-0f28-4d29-bb3b-6160e25edb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1628dec86fd4d89af4d5947c0860ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:01Z,use_quota=True,user_id='a591f764c5714d33bfaf588b35efb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da5b12d-2291-4159-a3fc-55ca2e3cd823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da5b12d-2291-4159-a3fc-55ca2e3cd823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148b167-a4f4-40ac-8864-fe614ea32dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9148b167-a4f4-40ac-8864-fe614ea32dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f99b48f-0f28-4d29-bb3b-6160e25edb27', 'volume_name': 'volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc1242f-ead3-4e46-9841-378a5ca789b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc1242f-ead3-4e46-9841-378a5ca789b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7fb4a1-2bcf-48a4-849b-799f8ef0c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Volume 0f99b48f-0f28-4d29-bb3b-6160e25edb27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27', 'volume_size': 1} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424525983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f99b48f-0f28-4d29-bb3b-6160e25edb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1628dec86fd4d89af4d5947c0860ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:01Z,use_quota=True,user_id='a591f764c5714d33bfaf588b35efb4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Creating volume 0f99b48f-0f28-4d29-bb3b-6160e25edb27 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:00 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:00 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 1073741824 Sep 28 16:13:00 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:01 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 1073741824" returned: 0 in 0.788s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:01 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 Sep 28 16:13:01 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:02 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27" returned: 0 in 0.334s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7fb4a1-2bcf-48a4-849b-799f8ef0c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b9680e-ba1c-4e18-b9ae-3c03bc53d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:02 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Volume volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 (0f99b48f-0f28-4d29-bb3b-6160e25edb27): created successfully Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b9680e-ba1c-4e18-b9ae-3c03bc53d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Flow 'volume_create_manager' (fbab66fd-64f1-44dd-9d6a-16fdbf076f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6b3d00a2-8af7-4290-ba7a-7ccaaa040ef1 tempest-ProjectReaderTests-1347446559 None] Created volume successfully. Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Acquiring lock "cinder-0f99b48f-0f28-4d29-bb3b-6160e25edb27-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Lock "cinder-0f99b48f-0f28-4d29-bb3b-6160e25edb27-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Acquiring lock "cinder-quobyte-0f99b48f-0f28-4d29-bb3b-6160e25edb27" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Lock "cinder-quobyte-0f99b48f-0f28-4d29-bb3b-6160e25edb27" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a7de9-8a51-4f06-81e8-deca76063065]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:03 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 Sep 28 16:13:03 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:03 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27" returned: 0 in 0.602s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:03 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27 Sep 28 16:13:03 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:04 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0f99b48f-0f28-4d29-bb3b-6160e25edb27" returned: 0 in 0.333s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Lock "cinder-quobyte-0f99b48f-0f28-4d29-bb3b-6160e25edb27" released by "delete_volume" :: held 1.007s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=75,cinder:UPDATE=81,cinder:INSERT=22,cinder:DELETE=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=87,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=8 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Created reservations ['440d97a6-412d-4bb5-8870-0370ec672db5', 'fb9c00d7-7319-41af-b7d5-08c93eb58487', '2f4c4f41-384b-460e-b33a-69aabcf76084', '181e80c7-df80-4df6-b435-4acd2a619110'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:04 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:04 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:04 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.323s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Deleted volume successfully. Sep 28 16:13:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2e84f3a-793c-4719-8f8e-f75b595de08e tempest-ProjectReaderTests-1347446559 None] Lock "cinder-0f99b48f-0f28-4d29-bb3b-6160e25edb27-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:09 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Flow 'volume_create_manager' (02e09fc0-7167-4ba2-aea4-4413d868d91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda11526-7593-43a7-9589-78e8680e4608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda11526-7593-43a7-9589-78e8680e4608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1745899142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f08719-51d1-4e56-a337-6c10a0fc0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9736f714a604c93bef11480da1d0ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:10Z,use_quota=True,user_id='1a676b089db647de947d2c4c0ce71273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd7248d-ccfc-470d-baff-cd5eaec8c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd7248d-ccfc-470d-baff-cd5eaec8c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b6412c-1317-4d65-a5d4-ca989fb3c312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b6412c-1317-4d65-a5d4-ca989fb3c312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f08719-51d1-4e56-a337-6c10a0fc0037', 'volume_name': 'volume-f4f08719-51d1-4e56-a337-6c10a0fc0037', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e342213-ec06-4b00-9359-3f2d868743ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e342213-ec06-4b00-9359-3f2d868743ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2fe768-69ba-4fd8-8baf-985c8a37b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Volume f4f08719-51d1-4e56-a337-6c10a0fc0037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f08719-51d1-4e56-a337-6c10a0fc0037', 'volume_size': 1} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1745899142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f08719-51d1-4e56-a337-6c10a0fc0037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9736f714a604c93bef11480da1d0ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:10Z,use_quota=True,user_id='1a676b089db647de947d2c4c0ce71273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Creating volume f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:10 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:10 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 1073741824 Sep 28 16:13:10 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:10 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 1073741824" returned: 0 in 0.807s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:11 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 Sep 28 16:13:11 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:11 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037" returned: 0 in 0.389s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2fe768-69ba-4fd8-8baf-985c8a37b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f08719-51d1-4e56-a337-6c10a0fc0037', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f60f6c-882a-479b-92cd-60143f3bff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Volume volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 (f4f08719-51d1-4e56-a337-6c10a0fc0037): created successfully Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f60f6c-882a-479b-92cd-60143f3bff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Flow 'volume_create_manager' (02e09fc0-7167-4ba2-aea4-4413d868d91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:11 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7242511b-06bc-43da-a982-f8f78553efeb tempest-VolumesCloneTest-1136202803 None] Created volume successfully. Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (2bc6838e-3037-4f12-b641-21b21e4370ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cbcd66-bac1-4a72-8384-4b74d20a01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cbcd66-bac1-4a72-8384-4b74d20a01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402453686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4340fe-179b-4072-a664-6b344d435c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:12Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b9d063-e8a9-434d-b5cc-71fbb859026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b9d063-e8a9-434d-b5cc-71fbb859026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247fa2fc-9631-42bc-8747-787e4ab0147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247fa2fc-9631-42bc-8747-787e4ab0147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4340fe-179b-4072-a664-6b344d435c21', 'volume_name': 'volume-dc4340fe-179b-4072-a664-6b344d435c21', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d96b1ce-25d7-482d-8771-559af3760a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d96b1ce-25d7-482d-8771-559af3760a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd3e8b6-0164-4459-8bb8-bc885866d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Volume dc4340fe-179b-4072-a664-6b344d435c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4340fe-179b-4072-a664-6b344d435c21', 'volume_size': 1} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402453686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4340fe-179b-4072-a664-6b344d435c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:12Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Creating volume dc4340fe-179b-4072-a664-6b344d435c21 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:11 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:11 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 1073741824 Sep 28 16:13:11 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:12 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 1073741824" returned: 0 in 0.757s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:12 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 Sep 28 16:13:12 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:12 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Flow 'volume_create_manager' (9decf073-88aa-4c67-bb14-a720efd31b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1424f69a-aa9e-4ac3-bf7f-8f5d1f926773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1424f69a-aa9e-4ac3-bf7f-8f5d1f926773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1643802329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312b1df4-2617-411d-9f6d-25404e17f3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9736f714a604c93bef11480da1d0ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f4f08719-51d1-4e56-a337-6c10a0fc0037,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:13Z,use_quota=True,user_id='1a676b089db647de947d2c4c0ce71273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e62f16-fdb8-48f7-8098-86f5a5c64e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e62f16-fdb8-48f7-8098-86f5a5c64e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb983c1f-1f8e-4d9d-94b2-64927af28167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:13 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb983c1f-1f8e-4d9d-94b2-64927af28167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '312b1df4-2617-411d-9f6d-25404e17f3bd', 'volume_name': 'volume-312b1df4-2617-411d-9f6d-25404e17f3bd', 'volume_size': 2, 'source_volid': 'f4f08719-51d1-4e56-a337-6c10a0fc0037', 'source_volstatus': 'available'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc74ce96-987f-4c9d-8d93-03c20f489f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc74ce96-987f-4c9d-8d93-03c20f489f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e79d3b6-5eac-4c9e-a2c0-bbe0eeee235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Volume 312b1df4-2617-411d-9f6d-25404e17f3bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-312b1df4-2617-411d-9f6d-25404e17f3bd', 'volume_size': 2, 'source_volid': 'f4f08719-51d1-4e56-a337-6c10a0fc0037', 'source_volstatus': 'available'} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21" returned: 0 in 0.425s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:13 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Cloning volume f4f08719-51d1-4e56-a337-6c10a0fc0037 to volume 312b1df4-2617-411d-9f6d-25404e17f3bd Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd3e8b6-0164-4459-8bb8-bc885866d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4340fe-179b-4072-a664-6b344d435c21', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1126de35-6836-4c22-be58-39d7ae6de5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Volume volume-dc4340fe-179b-4072-a664-6b344d435c21 (dc4340fe-179b-4072-a664-6b344d435c21): created successfully Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1126de35-6836-4c22-be58-39d7ae6de5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (2bc6838e-3037-4f12-b641-21b21e4370ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6a19da86-7a11-429b-84d8-d66b95fbfabd tempest-ProjectReaderTests-1524601259 None] Created volume successfully. Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Creating offline snapshot 6057e921-c357-45ce-8721-624e73cd4f40 of volume f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[464590c8-518e-45fe-93a5-60d90c1d90ac]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:13 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 Sep 28 16:13:13 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:14 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037" returned: 0 in 0.659s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:14 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 1G Sep 28 16:13:14 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-dc4340fe-179b-4072-a664-6b344d435c21-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Lock "cinder-dc4340fe-179b-4072-a664-6b344d435c21-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-quobyte-dc4340fe-179b-4072-a664-6b344d435c21" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-dc4340fe-179b-4072-a664-6b344d435c21" acquired by "delete_volume" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc32c63a-685a-447e-81d3-1f9ed8bb479b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:14 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 Sep 28 16:13:14 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:14 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 1G" returned: 0 in 0.711s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:14 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 Sep 28 16:13:14 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21" returned: 0 in 0.628s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:15 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21 Sep 28 16:13:15 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40" returned: 0 in 0.409s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 is being set with open permissions: ugo+rw Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:15 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 Sep 28 16:13:15 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dc4340fe-179b-4072-a664-6b344d435c21" returned: 0 in 0.359s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-dc4340fe-179b-4072-a664-6b344d435c21" released by "delete_volume" :: held 1.065s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:15 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Created reservations ['e6a38f7f-4381-414f-86c9-c7563e167c81', 'ce82b61b-9ac7-4f77-bffa-469d84ec442c', '6e0c55a9-4ca6-4395-b8f1-b567e441a952', '3f631f76-c547-459f-8199-b1c36fb39d4e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:15 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info Sep 28 16:13:15 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:15 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:15 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info" returned: 0 in 0.420s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info is being set with open permissions: ugo+rw Sep 28 16:13:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:16 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info Sep 28 16:13:16 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:16 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Deleted volume successfully. Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f346c6db-7091-4397-9312-e2d428b8991a tempest-ProjectReaderTests-1524601259 None] Lock "cinder-dc4340fe-179b-4072-a664-6b344d435c21-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:16 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.info" returned: 0 in 0.320s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "cinder-quobyte-312b1df4-2617-411d-9f6d-25404e17f3bd" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-312b1df4-2617-411d-9f6d-25404e17f3bd" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] snapshot: 6057e921-c357-45ce-8721-624e73cd4f40, volume: 312b1df4-2617-411d-9f6d-25404e17f3bd, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5f661b-b862-4283-ae9f-d622407fab61]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:16 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 Sep 28 16:13:16 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:16 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40" returned: 0 in 0.585s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4f08719-51d1-4e56-a337-6c10a0fc0037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b5d30e-fd8a-41bf-83a5-49dc1d80bb1d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:17 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 Sep 28 16:13:17 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (9bb22cea-3145-4dc1-8473-89118b40a1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df045d6-a56a-40f9-915b-1579d41e53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df045d6-a56a-40f9-915b-1579d41e53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717689450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8195b5c-f9f8-4634-8e40-abd033b972e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:17Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073e6b89-5e99-4ffd-943c-8db6636b7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073e6b89-5e99-4ffd-943c-8db6636b7eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55177624-9dad-4edc-b1d4-450d93ac83c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55177624-9dad-4edc-b1d4-450d93ac83c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8195b5c-f9f8-4634-8e40-abd033b972e0', 'volume_name': 'volume-f8195b5c-f9f8-4634-8e40-abd033b972e0', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03edfe2d-9f37-418e-8857-7092b423bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03edfe2d-9f37-418e-8857-7092b423bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ca7e2c-bfc3-45a8-bcdc-67f0560664e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:17 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Volume f8195b5c-f9f8-4634-8e40-abd033b972e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8195b5c-f9f8-4634-8e40-abd033b972e0', 'volume_size': 1} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:17 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037" returned: 0 in 0.482s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:13:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:17 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd Sep 28 16:13:17 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:26 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd" returned: 0 in 9.003s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:13:26 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Converted 1024.00 MB image at 113.72 MB/s Sep 28 16:13:26 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd is being set with open permissions: ugo+rw Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:26 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd Sep 28 16:13:26 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:26 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:26 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:26 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd" returned: 0 in 0.282s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-312b1df4-2617-411d-9f6d-25404e17f3bd" released by "_copy_volume_from_snapshot" :: held 10.481s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "cinder-quobyte-6057e921-c357-45ce-8721-624e73cd4f40" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-6057e921-c357-45ce-8721-624e73cd4f40" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Deleting offline snapshot 6057e921-c357-45ce-8721-624e73cd4f40 of volume f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] snapshot_file for this snap is: volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[68191098-db09-40c5-b1ca-cc9a8f50bd5c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:27 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 Sep 28 16:13:27 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:27 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=21 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:27 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40" returned: 0 in 0.526s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4f08719-51d1-4e56-a337-6c10a0fc0037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b0df8b-2beb-4cf9-9d73-fbd4a4cee9ce]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:27 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 Sep 28 16:13:27 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:28 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037" returned: 0 in 0.753s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:28 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 Sep 28 16:13:28 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:28 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40" returned: 0 in 0.417s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:28 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40 Sep 28 16:13:28 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:28 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037.6057e921-c357-45ce-8721-624e73cd4f40" returned: 0 in 0.292s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-6057e921-c357-45ce-8721-624e73cd4f40" released by "_delete_snapshot" :: held 2.121s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.814s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.722s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717689450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8195b5c-f9f8-4634-8e40-abd033b972e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:17Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Creating volume f8195b5c-f9f8-4634-8e40-abd033b972e0 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:29 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e79d3b6-5eac-4c9e-a2c0-bbe0eeee235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312b1df4-2617-411d-9f6d-25404e17f3bd', 'volume_size': 2, 'source_volid': 'f4f08719-51d1-4e56-a337-6c10a0fc0037', 'source_volstatus': 'available'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b865afc-497d-4c35-a1c3-d0ffafe56f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:29 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 1073741824 Sep 28 16:13:29 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Volume volume-312b1df4-2617-411d-9f6d-25404e17f3bd (312b1df4-2617-411d-9f6d-25404e17f3bd): created successfully Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b865afc-497d-4c35-a1c3-d0ffafe56f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Flow 'volume_create_manager' (9decf073-88aa-4c67-bb14-a720efd31b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:29 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9fef2a4a-46f4-4ea7-8e68-be5be90191a0 tempest-VolumesCloneTest-1136202803 None] Created volume successfully. Sep 28 16:13:30 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 1073741824" returned: 0 in 0.937s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:30 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 Sep 28 16:13:30 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "cinder-312b1df4-2617-411d-9f6d-25404e17f3bd-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-312b1df4-2617-411d-9f6d-25404e17f3bd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:30 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0" returned: 0 in 0.439s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "cinder-quobyte-312b1df4-2617-411d-9f6d-25404e17f3bd" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ca7e2c-bfc3-45a8-bcdc-67f0560664e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8195b5c-f9f8-4634-8e40-abd033b972e0', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30293f-4632-4099-b3bc-2cfb8b087cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-312b1df4-2617-411d-9f6d-25404e17f3bd" acquired by "delete_volume" :: waited 0.057s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Volume volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 (f8195b5c-f9f8-4634-8e40-abd033b972e0): created successfully Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30293f-4632-4099-b3bc-2cfb8b087cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (9bb22cea-3145-4dc1-8473-89118b40a1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d8a5f-c3b6-4ed8-87f5-33fa43ee76bd]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-eba21569-99e3-4c1e-aee3-bfa5d4d98ade tempest-ProjectReaderTests-1524601259 None] Created volume successfully. Sep 28 16:13:30 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd Sep 28 16:13:30 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-f8195b5c-f9f8-4634-8e40-abd033b972e0-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-f8195b5c-f9f8-4634-8e40-abd033b972e0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-quobyte-f8195b5c-f9f8-4634-8e40-abd033b972e0" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-f8195b5c-f9f8-4634-8e40-abd033b972e0" acquired by "delete_volume" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71127c8-e34a-452a-8510-816efec4c5a4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:31 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd" returned: 0 in 0.609s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:31 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd Sep 28 16:13:31 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:31 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 Sep 28 16:13:31 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:31 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-312b1df4-2617-411d-9f6d-25404e17f3bd" returned: 0 in 0.423s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-312b1df4-2617-411d-9f6d-25404e17f3bd" released by "delete_volume" :: held 1.114s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Created reservations ['f9f5d2c1-3554-45f7-ad77-d7dfbd369169', 'de0c1e49-a3c9-4270-9ce3-59df920e415b', 'c2bc28bf-f416-4be2-949d-679ac927ff32', 'aa8a9010-4047-403e-a0b3-bdd0659754c5'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:31 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0" returned: 0 in 0.652s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:31 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0 Sep 28 16:13:31 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:31 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:31 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:32 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f8195b5c-f9f8-4634-8e40-abd033b972e0" returned: 0 in 0.373s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:32 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-f8195b5c-f9f8-4634-8e40-abd033b972e0" released by "delete_volume" :: held 1.105s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Deleted volume successfully. Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-073a8d0e-689a-4c6d-aab5-68547cffee44 tempest-VolumesCloneTest-1136202803 None] Lock "cinder-312b1df4-2617-411d-9f6d-25404e17f3bd-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Created reservations ['1b1ff9c4-ada7-4db8-a6a6-d61fda27d214', '86570009-4859-4638-8ce6-16e09df935eb', 'ad816adf-4fe2-4ab4-8fc6-894bc35c6170', '2159dfd7-d259-4548-a824-217ad531fa3a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:32 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:32 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:32 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.404s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Deleted volume successfully. Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ea4360ac-3862-4663-8342-2f0aafc2cc78 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-f8195b5c-f9f8-4634-8e40-abd033b972e0-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Acquiring lock "cinder-f4f08719-51d1-4e56-a337-6c10a0fc0037-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Lock "cinder-f4f08719-51d1-4e56-a337-6c10a0fc0037-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Acquiring lock "cinder-quobyte-f4f08719-51d1-4e56-a337-6c10a0fc0037" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-f4f08719-51d1-4e56-a337-6c10a0fc0037" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f87f47-fee8-4511-bd9f-899c59bab1f3]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:33 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 Sep 28 16:13:33 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:33 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037" returned: 0 in 0.594s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:33 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037 Sep 28 16:13:33 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:34 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (43c456fc-ffcc-480b-8eb1-7c9546164ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de90e63b-015e-451c-861e-584777f10f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f4f08719-51d1-4e56-a337-6c10a0fc0037" returned: 0 in 0.569s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de90e63b-015e-451c-861e-584777f10f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678149940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b36cdd-8daf-4bd6-9160-2073e7ada518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:34Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fdf26f-ecdd-45b6-a8aa-dc8199e9fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fdf26f-ecdd-45b6-a8aa-dc8199e9fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9d9a75-b76f-479d-aa48-4b78a9b5ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9d9a75-b76f-479d-aa48-4b78a9b5ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b36cdd-8daf-4bd6-9160-2073e7ada518', 'volume_name': 'volume-80b36cdd-8daf-4bd6-9160-2073e7ada518', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932029b9-8f7c-467d-8116-c19dfc894414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932029b9-8f7c-467d-8116-c19dfc894414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364b0aa0-6681-45e8-86b3-3e222778b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:34 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Volume 80b36cdd-8daf-4bd6-9160-2073e7ada518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b36cdd-8daf-4bd6-9160-2073e7ada518', 'volume_size': 1} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678149940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b36cdd-8daf-4bd6-9160-2073e7ada518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:34Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Creating volume 80b36cdd-8daf-4bd6-9160-2073e7ada518 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:34 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Lock "cinder-quobyte-f4f08719-51d1-4e56-a337-6c10a0fc0037" released by "delete_volume" :: held 1.354s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:34 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 1073741824 Sep 28 16:13:34 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Created reservations ['8af82cee-ca73-4e38-b44a-49db93c0192d', '9559c232-bf1c-4b6e-96a6-88e5fd4a8a56', '1c5a31c0-b4c5-4e3a-9838-8a01f8000b83', 'c0774c7f-99b7-49b0-9136-4563f9f2fe8d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:34 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:34 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:34 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.356s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:34 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Deleted volume successfully. Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-046ee0c9-dd95-4514-b0d9-43e3e6591bdd tempest-VolumesCloneTest-1136202803 None] Lock "cinder-f4f08719-51d1-4e56-a337-6c10a0fc0037-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:35 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 1073741824" returned: 0 in 0.624s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:35 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 Sep 28 16:13:35 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:35 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518" returned: 0 in 0.375s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364b0aa0-6681-45e8-86b3-3e222778b43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b36cdd-8daf-4bd6-9160-2073e7ada518', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225fd30f-80fb-46be-a6a2-9846568b7189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:35 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Volume volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 (80b36cdd-8daf-4bd6-9160-2073e7ada518): created successfully Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225fd30f-80fb-46be-a6a2-9846568b7189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (43c456fc-ffcc-480b-8eb1-7c9546164ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3ecf9755-a1ee-45a6-9492-58804e30dd1b tempest-ProjectReaderTests-1524601259 None] Created volume successfully. Sep 28 16:13:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-80b36cdd-8daf-4bd6-9160-2073e7ada518-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-80b36cdd-8daf-4bd6-9160-2073e7ada518-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-quobyte-80b36cdd-8daf-4bd6-9160-2073e7ada518" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-80b36cdd-8daf-4bd6-9160-2073e7ada518" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:36 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[62913b52-3a2b-4dd5-8c8c-9f47b69d3b24]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:36 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 Sep 28 16:13:36 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:37 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518" returned: 0 in 0.594s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:37 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518 Sep 28 16:13:37 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:37 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-80b36cdd-8daf-4bd6-9160-2073e7ada518" returned: 0 in 0.411s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-80b36cdd-8daf-4bd6-9160-2073e7ada518" released by "delete_volume" :: held 1.127s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Created reservations ['66ed6491-0597-49d4-ac4c-9ee327e38268', '61fd821e-f457-4dd3-8492-00a2e85d1b92', 'bc218d9f-cbcb-4a61-a553-066220d891d8', '383c3a4b-788a-4469-8e49-753aa08037f6'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:37 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:37 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:38 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:38 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Deleted volume successfully. Sep 28 16:13:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ff117e27-8edb-48ac-9880-56653463bc30 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-80b36cdd-8daf-4bd6-9160-2073e7ada518-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (f661d53a-0bbd-43da-8300-9f0af963a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfab775-ba42-41da-9d7f-20a07e7c904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfab775-ba42-41da-9d7f-20a07e7c904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755642420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baac6c-2f1e-45c4-90b4-0e66f9b14a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:40Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05754d9-fbb4-4f68-b996-fd5876eefed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05754d9-fbb4-4f68-b996-fd5876eefed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c380cb01-65f4-4f77-ad9b-25ce89b7bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c380cb01-65f4-4f77-ad9b-25ce89b7bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69baac6c-2f1e-45c4-90b4-0e66f9b14a46', 'volume_name': 'volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568cd9bd-5c64-47d6-98ea-a58766353318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568cd9bd-5c64-47d6-98ea-a58766353318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc39eba-0377-47a5-a120-b077479232eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:39 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Volume 69baac6c-2f1e-45c4-90b4-0e66f9b14a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46', 'volume_size': 1} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755642420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baac6c-2f1e-45c4-90b4-0e66f9b14a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d36c02a578104a3eae67cbeb4465c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:40Z,use_quota=True,user_id='166964fa6a4e4736844c4b6c71c2a364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Creating volume 69baac6c-2f1e-45c4-90b4-0e66f9b14a46 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:39 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:39 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 1073741824 Sep 28 16:13:39 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 1073741824" returned: 0 in 0.673s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:40 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 Sep 28 16:13:40 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc39eba-0377-47a5-a120-b077479232eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1153a5d1-57e5-4d75-a6cf-3e25e7621939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:40 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Volume volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 (69baac6c-2f1e-45c4-90b4-0e66f9b14a46): created successfully Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1153a5d1-57e5-4d75-a6cf-3e25e7621939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:40 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Flow 'volume_create_manager' (f661d53a-0bbd-43da-8300-9f0af963a97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:41 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0d119ede-8bfc-4096-a6e3-dfa72cec43d1 tempest-ProjectReaderTests-1524601259 None] Created volume successfully. Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Flow 'volume_create_manager' (6397a0a1-51e3-4cbd-9ba8-3ef3920ada4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5affd681-1658-47f9-b277-456991c9b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5affd681-1658-47f9-b277-456991c9b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1675441618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bcf5e8-fe67-4968-9c47-1180afb3ca56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdb842975204e30b7b995f8356b4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:41Z,use_quota=True,user_id='d5b705ac4d314c24bafb8c1e24fbf36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b2c99c-d584-4b1e-8846-7608085a4f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b2c99c-d584-4b1e-8846-7608085a4f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e16517-c3a9-4dbe-92cf-8c85cea52a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e16517-c3a9-4dbe-92cf-8c85cea52a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bcf5e8-fe67-4968-9c47-1180afb3ca56', 'volume_name': 'volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ca521c-9721-43b9-83b9-2d5541514edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ca521c-9721-43b9-83b9-2d5541514edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dda406-27ff-4927-a4eb-8e2a2760edde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Volume 98bcf5e8-fe67-4968-9c47-1180afb3ca56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56', 'volume_size': 1} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1675441618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bcf5e8-fe67-4968-9c47-1180afb3ca56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdb842975204e30b7b995f8356b4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:41Z,use_quota=True,user_id='d5b705ac4d314c24bafb8c1e24fbf36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Creating volume 98bcf5e8-fe67-4968-9c47-1180afb3ca56 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:41 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:41 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 1073741824 Sep 28 16:13:41 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Flow 'volume_create_manager' (277f7187-53ae-4a2d-9717-4c2edaa1137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1225b5-c0a4-44c4-843b-ce694376b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1225b5-c0a4-44c4-843b-ce694376b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-22885504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03da58b0-fada-43a9-9d1a-1c0426ba2235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255703a0b61d4f7d894f6d84067b1e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:41Z,use_quota=True,user_id='14b8e81e09fc4cc895052836d87e6d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9177ef09-1f28-4ff8-90a4-8df8027e4033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9177ef09-1f28-4ff8-90a4-8df8027e4033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc25608-fbb4-40ad-9dc2-ce99dd2c7508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc25608-fbb4-40ad-9dc2-ce99dd2c7508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03da58b0-fada-43a9-9d1a-1c0426ba2235', 'volume_name': 'volume-03da58b0-fada-43a9-9d1a-1c0426ba2235', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de33d28-77ca-45bf-b538-9c1d5313cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de33d28-77ca-45bf-b538-9c1d5313cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4e85cb-9e0f-48b5-80f1-9bf26031eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Volume 03da58b0-fada-43a9-9d1a-1c0426ba2235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03da58b0-fada-43a9-9d1a-1c0426ba2235', 'volume_size': 1} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Flow 'volume_create_manager' (d97cb8d1-3b35-446e-b028-9f6ade20d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b2d25a-aacf-49d8-8198-d0edde297547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b2d25a-aacf-49d8-8198-d0edde297547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205299663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131bf634-dda9-4471-879f-60818719ae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdb842975204e30b7b995f8356b4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:41Z,use_quota=True,user_id='d5b705ac4d314c24bafb8c1e24fbf36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e971b5-a027-4e90-8fef-9550f003393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e971b5-a027-4e90-8fef-9550f003393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48006104-6d63-4899-af8a-149dc1e7933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48006104-6d63-4899-af8a-149dc1e7933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131bf634-dda9-4471-879f-60818719ae12', 'volume_name': 'volume-131bf634-dda9-4471-879f-60818719ae12', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdeea60e-d281-44e3-aca5-1d3d4ac74d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdeea60e-d281-44e3-aca5-1d3d4ac74d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22b0556-b8bf-4ce3-9649-8ed45a2504c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:41 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Volume 131bf634-dda9-4471-879f-60818719ae12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131bf634-dda9-4471-879f-60818719ae12', 'volume_size': 1} Sep 28 16:13:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-69baac6c-2f1e-45c4-90b4-0e66f9b14a46-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:42 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 1073741824" returned: 0 in 0.687s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-69baac6c-2f1e-45c4-90b4-0e66f9b14a46-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "cinder-quobyte-69baac6c-2f1e-45c4-90b4-0e66f9b14a46" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:42 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-69baac6c-2f1e-45c4-90b4-0e66f9b14a46" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:42 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a7c7b-6ea7-489f-bad4-4bc075f85e37]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 Sep 28 16:13:42 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:42 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56" returned: 0 in 0.417s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-22885504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03da58b0-fada-43a9-9d1a-1c0426ba2235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255703a0b61d4f7d894f6d84067b1e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:41Z,use_quota=True,user_id='14b8e81e09fc4cc895052836d87e6d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Creating volume 03da58b0-fada-43a9-9d1a-1c0426ba2235 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:42 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9dda406-27ff-4927-a4eb-8e2a2760edde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69fca56-3d2e-4c24-8913-e332bf369b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:42 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 1073741824 Sep 28 16:13:42 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:42 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Volume volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 (98bcf5e8-fe67-4968-9c47-1180afb3ca56): created successfully Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69fca56-3d2e-4c24-8913-e332bf369b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Flow 'volume_create_manager' (6397a0a1-51e3-4cbd-9ba8-3ef3920ada4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2f5ba7a5-f464-42b4-a2a9-4ba91c46d510 tempest-TestServerVolumeAttachmentScenario-434186773 None] Created volume successfully. Sep 28 16:13:42 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46" returned: 0 in 0.547s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46 Sep 28 16:13:42 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-69baac6c-2f1e-45c4-90b4-0e66f9b14a46" returned: 0 in 0.344s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-quobyte-69baac6c-2f1e-45c4-90b4-0e66f9b14a46" released by "delete_volume" :: held 0.967s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Created reservations ['4685cd53-009d-46d5-8be2-6c80c353870d', '2e90002a-bef2-4299-b2d5-f9f126a21472', 'c4c4755e-5431-463c-9ea2-7fc45cd2b53f', '87381d97-efb2-4164-816e-346a34a81ac5'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:43 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 1073741824" returned: 0 in 0.726s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:13:43 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 Sep 28 16:13:43 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.334s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Deleted volume successfully. Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b031df0d-0690-4c4e-80f9-4b3ba44952f2 tempest-ProjectReaderTests-1524601259 None] Lock "cinder-69baac6c-2f1e-45c4-90b4-0e66f9b14a46-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:43 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235" returned: 0 in 0.404s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205299663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131bf634-dda9-4471-879f-60818719ae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bdb842975204e30b7b995f8356b4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:41Z,use_quota=True,user_id='d5b705ac4d314c24bafb8c1e24fbf36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Creating volume 131bf634-dda9-4471-879f-60818719ae12 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:43 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 1073741824 Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4e85cb-9e0f-48b5-80f1-9bf26031eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03da58b0-fada-43a9-9d1a-1c0426ba2235', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:43 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f070a58e-7040-408b-b473-267b3952cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:43 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Volume volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 (03da58b0-fada-43a9-9d1a-1c0426ba2235): created successfully Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f070a58e-7040-408b-b473-267b3952cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:43 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Flow 'volume_create_manager' (277f7187-53ae-4a2d-9717-4c2edaa1137e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e18bc08e-3ec4-4360-b48d-73350e92d3c1 tempest-VolumesNegativeTest-1751134380 None] Created volume successfully. Sep 28 16:13:44 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 1073741824" returned: 0 in 0.619s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:44 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 Sep 28 16:13:44 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:44 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12" returned: 0 in 0.400s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22b0556-b8bf-4ce3-9649-8ed45a2504c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131bf634-dda9-4471-879f-60818719ae12', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79adef08-607c-4ad2-8f0f-9c05fa7bf443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:44 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Volume volume-131bf634-dda9-4471-879f-60818719ae12 (131bf634-dda9-4471-879f-60818719ae12): created successfully Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79adef08-607c-4ad2-8f0f-9c05fa7bf443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Flow 'volume_create_manager' (d97cb8d1-3b35-446e-b028-9f6ade20d24f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:45 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-69fb8445-c9ab-42ee-9a9f-788b684e4545 tempest-TestServerVolumeAttachmentScenario-434186773 None] Created volume successfully. Sep 28 16:13:54 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:INSERT=23,cinder:UPDATE=84,cinder:SELECT=52,cinder:DELETE=10 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:55 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=64,cinder:SELECT=36,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Acquiring lock "cinder-03da58b0-fada-43a9-9d1a-1c0426ba2235-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Lock "cinder-03da58b0-fada-43a9-9d1a-1c0426ba2235-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Acquiring lock "cinder-quobyte-03da58b0-fada-43a9-9d1a-1c0426ba2235" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Lock "cinder-quobyte-03da58b0-fada-43a9-9d1a-1c0426ba2235" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:10 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1d5269-9ba2-4532-8da7-82896a405147]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 Sep 28 16:14:11 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:11 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235" returned: 0 in 0.445s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235 Sep 28 16:14:11 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:11 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-03da58b0-fada-43a9-9d1a-1c0426ba2235" returned: 0 in 0.350s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Lock "cinder-quobyte-03da58b0-fada-43a9-9d1a-1c0426ba2235" released by "delete_volume" :: held 0.847s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Created reservations ['c34b7ed5-2c41-4526-a03e-40d4dc5cadee', '9b641465-d209-4377-acaf-2c1aee1457e8', 'bab07ab7-ec63-45a1-b7fa-37f5b46f96e9', 'f6abbd39-2afe-4954-a303-ba771902a101'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:12 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:14:12 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:12 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.460s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:12 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Deleted volume successfully. Sep 28 16:14:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12492d99-3978-48e4-8491-da56050d8873 tempest-VolumesNegativeTest-1751134380 None] Lock "cinder-03da58b0-fada-43a9-9d1a-1c0426ba2235-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:21 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-af309a3f-bf91-4cf1-aa09-33995f077cb6 req-29b26367-53da-445a-9930-7c3af36f2a96 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-af309a3f-bf91-4cf1-aa09-33995f077cb6 req-29b26367-53da-445a-9930-7c3af36f2a96 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-af309a3f-bf91-4cf1-aa09-33995f077cb6 req-29b26367-53da-445a-9930-7c3af36f2a96 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-af309a3f-bf91-4cf1-aa09-33995f077cb6 req-29b26367-53da-445a-9930-7c3af36f2a96 tempest-TestServerVolumeAttachmentScenario-434186773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd685e5d-41cd-4ec6-8bcb-0e4d3ae81926', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:14:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-af309a3f-bf91-4cf1-aa09-33995f077cb6 req-29b26367-53da-445a-9930-7c3af36f2a96 tempest-TestServerVolumeAttachmentScenario-434186773 None] attachment_update completed successfully. Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:26 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:14:26 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:27 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-3a300405-430f-4a0d-9f06-f1780d052970 req-2ac1bb7f-f8e3-4efc-9200-82f5496e5cad tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-3a300405-430f-4a0d-9f06-f1780d052970 req-2ac1bb7f-f8e3-4efc-9200-82f5496e5cad tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-3a300405-430f-4a0d-9f06-f1780d052970 req-2ac1bb7f-f8e3-4efc-9200-82f5496e5cad tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-3a300405-430f-4a0d-9f06-f1780d052970 req-2ac1bb7f-f8e3-4efc-9200-82f5496e5cad tempest-TestServerVolumeAttachmentScenario-434186773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-131bf634-dda9-4471-879f-60818719ae12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adb153f8-77f3-4232-9ec0-98c605ee4915', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:14:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-3a300405-430f-4a0d-9f06-f1780d052970 req-2ac1bb7f-f8e3-4efc-9200-82f5496e5cad tempest-TestServerVolumeAttachmentScenario-434186773 None] attachment_update completed successfully. Sep 28 16:14:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-167dbd98-2750-462e-8660-1b19e8ac40cf req-6f084809-fd9e-423b-b090-0f410a9ab1dc tempest-TestServerVolumeAttachmentScenario-434186773 None] Terminate volume connection completed successfully. Sep 28 16:14:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-167dbd98-2750-462e-8660-1b19e8ac40cf req-6f084809-fd9e-423b-b090-0f410a9ab1dc tempest-TestServerVolumeAttachmentScenario-434186773 None] Deleting attachment adb153f8-77f3-4232-9ec0-98c605ee4915. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:14:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-4b5920a1-e774-40fd-8960-cc11352df560 req-9dd6b018-02f1-4894-b7e9-f3e8b6494156 tempest-TestServerVolumeAttachmentScenario-434186773 None] Terminate volume connection completed successfully. Sep 28 16:14:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-4b5920a1-e774-40fd-8960-cc11352df560 req-9dd6b018-02f1-4894-b7e9-f3e8b6494156 tempest-TestServerVolumeAttachmentScenario-434186773 None] Deleting attachment dd685e5d-41cd-4ec6-8bcb-0e4d3ae81926. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "cinder-131bf634-dda9-4471-879f-60818719ae12-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-131bf634-dda9-4471-879f-60818719ae12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "cinder-quobyte-131bf634-dda9-4471-879f-60818719ae12" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-quobyte-131bf634-dda9-4471-879f-60818719ae12" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b4b68-d583-4dd5-97df-54037bd3a2b0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:41 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 Sep 28 16:14:41 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:41 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12" returned: 0 in 0.490s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:41 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12 Sep 28 16:14:41 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:42 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-131bf634-dda9-4471-879f-60818719ae12" returned: 0 in 0.344s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-quobyte-131bf634-dda9-4471-879f-60818719ae12" released by "delete_volume" :: held 0.899s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Created reservations ['773ece74-61da-4c5c-b925-623ae2482db5', '69b30bc4-396a-4485-8467-a5e6a160e6cf', '8d0c8fd3-fcd4-454e-8162-dd039b0021d9', 'f6b1c106-029f-4a32-ad1b-98e0a883404a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:42 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:14:42 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "cinder-98bcf5e8-fe67-4968-9c47-1180afb3ca56-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-98bcf5e8-fe67-4968-9c47-1180afb3ca56-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "cinder-quobyte-98bcf5e8-fe67-4968-9c47-1180afb3ca56" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-quobyte-98bcf5e8-fe67-4968-9c47-1180afb3ca56" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[807f216d-4faa-4222-944d-427383894562]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:42 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Deleted volume successfully. Sep 28 16:14:42 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 Sep 28 16:14:42 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebae1ce0-bc16-46b0-a83a-d0e11d8ed7a1 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-131bf634-dda9-4471-879f-60818719ae12-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:43 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56" returned: 0 in 0.709s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:43 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56 Sep 28 16:14:43 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:43 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-98bcf5e8-fe67-4968-9c47-1180afb3ca56" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-quobyte-98bcf5e8-fe67-4968-9c47-1180afb3ca56" released by "delete_volume" :: held 1.148s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Created reservations ['4d20ff98-985d-43a4-a6ba-e96e61fe0f4a', 'cfc16e01-042b-4327-88b9-0e522064d551', '1820ab88-ba03-42e8-9c2c-7badd942499e', '562cb4d5-b704-4dc1-ad2a-2959aaffc934'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:43 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:14:43 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:44 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:44 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Deleted volume successfully. Sep 28 16:14:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-a0687288-4c46-4b71-acc5-f35bacdc9647 tempest-TestServerVolumeAttachmentScenario-434186773 None] Lock "cinder-98bcf5e8-fe67-4968-9c47-1180afb3ca56-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Flow 'volume_create_manager' (1de0b2ab-5a16-4e73-8585-9292c22dc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25364c61-a1e8-4767-be8a-460a774c34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25364c61-a1e8-4767-be8a-460a774c34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1660309649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e780a6-464e-4da6-9f57-4a17babea8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968cdd2333964996a61f338ab6bc0b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:49Z,use_quota=True,user_id='598cdd8bce51484f9ecedbc9a3d3bae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0500a4f2-cda6-4fca-bcca-af7ad105f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0500a4f2-cda6-4fca-bcca-af7ad105f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0696845-7f6e-41cb-acfa-3e1b5bbbcbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:48 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:14:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0696845-7f6e-41cb-acfa-3e1b5bbbcbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32e780a6-464e-4da6-9f57-4a17babea8c3', 'volume_name': 'volume-32e780a6-464e-4da6-9f57-4a17babea8c3', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bfd639-8aef-4398-b17a-a968cd76bab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bfd639-8aef-4398-b17a-a968cd76bab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1399e4f-f09d-4fe6-a5c2-ef7ca60fbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Volume 32e780a6-464e-4da6-9f57-4a17babea8c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32e780a6-464e-4da6-9f57-4a17babea8c3', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:14:49 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Trying to clone 32e780a6-464e-4da6-9f57-4a17babea8c3 from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:14:50 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b95528a-c3b1-4bb4-a627-736bb531e1ba]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:50 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD Sep 28 16:14:50 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:50 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 is fetched for user 598cdd8bce51484f9ecedbc9a3d3bae6. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b08cf-8db3-4467-b563-4e97a0977ed1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:50 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD Sep 28 16:14:50 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:51 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1660309649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e780a6-464e-4da6-9f57-4a17babea8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968cdd2333964996a61f338ab6bc0b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:49Z,use_quota=True,user_id='598cdd8bce51484f9ecedbc9a3d3bae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Creating volume 32e780a6-464e-4da6-9f57-4a17babea8c3 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:51 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:51 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 1073741824 Sep 28 16:14:51 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:51 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 1073741824" returned: 0 in 0.549s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:51 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 Sep 28 16:14:51 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:52 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3" returned: 0 in 0.317s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Attempting download of dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume 32e780a6-464e-4da6-9f57-4a17babea8c3. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0f95f-7de8-4932-a17d-2a100f330ebb]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:52 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz Sep 28 16:14:52 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:52 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:52 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz Sep 28 16:14:52 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:53 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz" returned: 1 in 0.450s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_hlcx19kz' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956cd04-dc2e-4089-999d-ec10959914ac]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:53 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD Sep 28 16:14:53 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:53 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 was qcow2, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:14:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:53 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 Sep 28 16:14:53 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:56 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3" returned: 0 in 2.433s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3_upbn4y4jdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:14:56 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Converted 112.00 MB image at 46.00 MB/s Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:56 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 1G Sep 28 16:14:56 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:56 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 1G" returned: 0 in 0.451s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Downloaded image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}])) to volume 32e780a6-464e-4da6-9f57-4a17babea8c3 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Temporary image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 for user 598cdd8bce51484f9ecedbc9a3d3bae6 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Marking volume 32e780a6-464e-4da6-9f57-4a17babea8c3 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Copying metadata from image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 to 32e780a6-464e-4da6-9f57-4a17babea8c3. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Creating volume glance metadata for volume 32e780a6-464e-4da6-9f57-4a17babea8c3 backed by image dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1399e4f-f09d-4fe6-a5c2-ef7ca60fbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e780a6-464e-4da6-9f57-4a17babea8c3', 'volume_size': 1, 'image_id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '502f1ac7258242fb935c63a37a93b539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3', 'created_at': datetime.datetime(2026, 9, 28, 13, 48, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 48, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcdd9a53-8d66-4cb4-a1f1-e3e74c3962c3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b69c69-fa6c-40f7-b8d8-8466d40c14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Volume volume-32e780a6-464e-4da6-9f57-4a17babea8c3 (32e780a6-464e-4da6-9f57-4a17babea8c3): created successfully Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b69c69-fa6c-40f7-b8d8-8466d40c14fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Flow 'volume_create_manager' (1de0b2ab-5a16-4e73-8585-9292c22dc466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:56 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9d9333e8-bf8a-42cb-9371-7fa5eff1041a tempest-TestShelveInstance-1967532999 None] Created volume successfully. Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-9b384edf-a8ad-4558-ac22-e3df901762c6 req-d05e3f1d-d8c3-4367-84b9-e17564b2d33e tempest-TestShelveInstance-1967532999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-9b384edf-a8ad-4558-ac22-e3df901762c6 req-d05e3f1d-d8c3-4367-84b9-e17564b2d33e tempest-TestShelveInstance-1967532999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-9b384edf-a8ad-4558-ac22-e3df901762c6 req-d05e3f1d-d8c3-4367-84b9-e17564b2d33e tempest-TestShelveInstance-1967532999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (a61986fd-b1a7-4eae-b1f5-fb45bcabf43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24494c6-d855-42fa-8fbb-123dd43da658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24494c6-d855-42fa-8fbb-123dd43da658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226075453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc33754-1138-4731-a877-d703185bb628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:01Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a332844d-472a-48d9-972b-54ad98226104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a332844d-472a-48d9-972b-54ad98226104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9611a7-9e2d-41b0-a069-c1d68eaf5a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9611a7-9e2d-41b0-a069-c1d68eaf5a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc33754-1138-4731-a877-d703185bb628', 'volume_name': 'volume-0cc33754-1138-4731-a877-d703185bb628', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e589862-a296-406b-83fe-1ecbcdf8ca1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e589862-a296-406b-83fe-1ecbcdf8ca1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db8dc74-25e3-4dcf-b161-7eb48ee43509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume 0cc33754-1138-4731-a877-d703185bb628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc33754-1138-4731-a877-d703185bb628', 'volume_size': 1} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226075453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc33754-1138-4731-a877-d703185bb628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:01Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Creating volume 0cc33754-1138-4731-a877-d703185bb628 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:00 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:15:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-9b384edf-a8ad-4558-ac22-e3df901762c6 req-d05e3f1d-d8c3-4367-84b9-e17564b2d33e tempest-TestShelveInstance-1967532999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-32e780a6-464e-4da6-9f57-4a17babea8c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26096b73-17d4-454e-a979-cf579e8ecbc7', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:15:01 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 1073741824 Sep 28 16:15:01 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-9b384edf-a8ad-4558-ac22-e3df901762c6 req-d05e3f1d-d8c3-4367-84b9-e17564b2d33e tempest-TestShelveInstance-1967532999 None] attachment_update completed successfully. Sep 28 16:15:01 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 1073741824" returned: 0 in 0.830s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:01 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 Sep 28 16:15:01 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:02 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628" returned: 0 in 0.311s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db8dc74-25e3-4dcf-b161-7eb48ee43509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc33754-1138-4731-a877-d703185bb628', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fad14de-05f0-4e0b-b367-209cefb1d060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:02 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume volume-0cc33754-1138-4731-a877-d703185bb628 (0cc33754-1138-4731-a877-d703185bb628): created successfully Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fad14de-05f0-4e0b-b367-209cefb1d060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (a61986fd-b1a7-4eae-b1f5-fb45bcabf43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-78eb281a-e0a0-4d06-97b3-3929b118b8e6 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created volume successfully. Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (0627e0b7-0f85-4be2-b410-f6b25f977eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad028de-dd14-45ce-bc2f-7e79b10b92a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad028de-dd14-45ce-bc2f-7e79b10b92a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789293433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a41173-e4b9-444e-8e46-dff0960c827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:04Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cbe0f4-a839-4879-805a-2d8e9c63f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0cbe0f4-a839-4879-805a-2d8e9c63f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51065b9-7206-428b-8c8d-fc81b967e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51065b9-7206-428b-8c8d-fc81b967e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a41173-e4b9-444e-8e46-dff0960c827a', 'volume_name': 'volume-e9a41173-e4b9-444e-8e46-dff0960c827a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e702c91a-8735-452a-9caf-015ff668f576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e702c91a-8735-452a-9caf-015ff668f576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae324b9-453d-4eb4-8b20-21c81e79788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume e9a41173-e4b9-444e-8e46-dff0960c827a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a41173-e4b9-444e-8e46-dff0960c827a', 'volume_size': 1} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789293433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a41173-e4b9-444e-8e46-dff0960c827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:04Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Creating volume e9a41173-e4b9-444e-8e46-dff0960c827a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:03 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:15:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:03 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a 1073741824 Sep 28 16:15:03 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (acf10574-3928-45c6-bce1-79275667af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df10e5a-ca41-4ac4-bf68-7e4e71321489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df10e5a-ca41-4ac4-bf68-7e4e71321489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855447341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0ad4cc-44e1-426c-b838-b9584bf56576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:05Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e64aae7-800c-41ee-aea4-dc062ff455f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e64aae7-800c-41ee-aea4-dc062ff455f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ccd5da-4a57-4ead-9f10-7de57eeeb21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ccd5da-4a57-4ead-9f10-7de57eeeb21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0ad4cc-44e1-426c-b838-b9584bf56576', 'volume_name': 'volume-cd0ad4cc-44e1-426c-b838-b9584bf56576', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa9788c-7c13-4074-91cd-bde441374237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa9788c-7c13-4074-91cd-bde441374237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fe5f81-23b6-48a4-8361-4e8df21fb302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:04 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume cd0ad4cc-44e1-426c-b838-b9584bf56576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0ad4cc-44e1-426c-b838-b9584bf56576', 'volume_size': 1} Sep 28 16:15:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:04 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a 1073741824" returned: 0 in 1.109s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:05 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a Sep 28 16:15:05 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=56,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (758880de-7a33-428a-9eb9-9569b08eb01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81d60de-2561-40b0-bc77-63a33833af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81d60de-2561-40b0-bc77-63a33833af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1505806119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c211927-7f7e-40f8-8b6d-24c3446bcd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:05Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994b2d65-701c-4e66-a48a-1d0335451f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:05 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994b2d65-701c-4e66-a48a-1d0335451f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd29dd0-a47d-45eb-8fd8-fc0d64a8cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd29dd0-a47d-45eb-8fd8-fc0d64a8cf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c211927-7f7e-40f8-8b6d-24c3446bcd93', 'volume_name': 'volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4bbc45-e170-4dd4-9fe1-7905051deeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4bbc45-e170-4dd4-9fe1-7905051deeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0707cee-0c7d-47e2-86d8-2dd0ad6f0a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume 7c211927-7f7e-40f8-8b6d-24c3446bcd93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93', 'volume_size': 1} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a" returned: 0 in 0.788s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855447341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0ad4cc-44e1-426c-b838-b9584bf56576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:05Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Creating volume cd0ad4cc-44e1-426c-b838-b9584bf56576 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:05 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 1073741824 Sep 28 16:15:05 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae324b9-453d-4eb4-8b20-21c81e79788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a41173-e4b9-444e-8e46-dff0960c827a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884a6508-801a-4195-853b-12f70be55946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume volume-e9a41173-e4b9-444e-8e46-dff0960c827a (e9a41173-e4b9-444e-8e46-dff0960c827a): created successfully Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884a6508-801a-4195-853b-12f70be55946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (0627e0b7-0f85-4be2-b410-f6b25f977eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-003967b2-b2e3-43bf-9d3a-4c7745922ed9 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created volume successfully. Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (14c9da32-9d5a-42a4-b81a-5d69a0cd82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebea6aa-45c9-493a-b6d4-8675f0a10e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebea6aa-45c9-493a-b6d4-8675f0a10e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048799975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b876306-19bb-42da-b15b-ef676696abc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:06Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e98cc49-c800-4159-8715-e932c80eae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e98cc49-c800-4159-8715-e932c80eae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4230cfc9-5cdd-4e7b-86d2-34f68a14bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4230cfc9-5cdd-4e7b-86d2-34f68a14bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b876306-19bb-42da-b15b-ef676696abc2', 'volume_name': 'volume-4b876306-19bb-42da-b15b-ef676696abc2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ecd3b4-7125-4b34-b6c4-07625d7a819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ecd3b4-7125-4b34-b6c4-07625d7a819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e6fde-c3d6-485c-9856-02102538ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume 4b876306-19bb-42da-b15b-ef676696abc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b876306-19bb-42da-b15b-ef676696abc2', 'volume_size': 1} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:06 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 1073741824" returned: 0 in 0.844s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:06 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 Sep 28 16:15:06 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (07c93e75-7643-4fb8-a856-978b745f7e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:07 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53c2ef2-bcc5-47a0-a61e-011ce555a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576" returned: 0 in 0.358s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1505806119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c211927-7f7e-40f8-8b6d-24c3446bcd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:05Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Creating volume 7c211927-7f7e-40f8-8b6d-24c3446bcd93 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:07 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53c2ef2-bcc5-47a0-a61e-011ce555a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463486400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84275daf-1783-4885-a5b0-5c195fa29aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:07Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:07 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 1073741824 Sep 28 16:15:07 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d23a5bc-a4d3-495b-8673-fa25f00fc435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d23a5bc-a4d3-495b-8673-fa25f00fc435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e522bae-3bbb-4160-bdd5-b29ee6da7327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e522bae-3bbb-4160-bdd5-b29ee6da7327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84275daf-1783-4885-a5b0-5c195fa29aa1', 'volume_name': 'volume-84275daf-1783-4885-a5b0-5c195fa29aa1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834a5f9e-d547-42e5-b8fd-cb649166b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834a5f9e-d547-42e5-b8fd-cb649166b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d41411-fee0-4821-97e7-d05f7b72ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume 84275daf-1783-4885-a5b0-5c195fa29aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84275daf-1783-4885-a5b0-5c195fa29aa1', 'volume_size': 1} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fe5f81-23b6-48a4-8361-4e8df21fb302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0ad4cc-44e1-426c-b838-b9584bf56576', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24545be-34fd-4952-8555-cc62bd5f7c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 (cd0ad4cc-44e1-426c-b838-b9584bf56576): created successfully Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24545be-34fd-4952-8555-cc62bd5f7c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (acf10574-3928-45c6-bce1-79275667af34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c169f743-14c5-478f-a0b0-50e1a5053be4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created volume successfully. Sep 28 16:15:07 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 1073741824" returned: 0 in 0.633s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:07 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 Sep 28 16:15:07 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:08 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93" returned: 0 in 0.339s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048799975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b876306-19bb-42da-b15b-ef676696abc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:06Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Creating volume 4b876306-19bb-42da-b15b-ef676696abc2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:08 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0707cee-0c7d-47e2-86d8-2dd0ad6f0a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8a367c-f2ce-48c7-aaf4-ebbbfbc9906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:08 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 1073741824 Sep 28 16:15:08 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:08 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 (7c211927-7f7e-40f8-8b6d-24c3446bcd93): created successfully Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8a367c-f2ce-48c7-aaf4-ebbbfbc9906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (758880de-7a33-428a-9eb9-9569b08eb01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9985c742-92d4-4775-a202-60a134fbc930 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created volume successfully. Sep 28 16:15:08 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 1073741824" returned: 0 in 0.707s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:09 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 Sep 28 16:15:09 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:09 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463486400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84275daf-1783-4885-a5b0-5c195fa29aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aad115696a4e77995d0b37b53e3d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:07Z,use_quota=True,user_id='75e40459825743e7a4bb4848dc0a5e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Creating volume 84275daf-1783-4885-a5b0-5c195fa29aa1 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:09 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:09 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 1073741824 Sep 28 16:15:09 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e6fde-c3d6-485c-9856-02102538ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b876306-19bb-42da-b15b-ef676696abc2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba9d795-b662-4368-a45e-fc4e3b711dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:09 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume volume-4b876306-19bb-42da-b15b-ef676696abc2 (4b876306-19bb-42da-b15b-ef676696abc2): created successfully Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba9d795-b662-4368-a45e-fc4e3b711dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (14c9da32-9d5a-42a4-b81a-5d69a0cd82b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:09 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cc67d032-3591-4c8e-82a1-f57e1d14cbe0 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created volume successfully. Sep 28 16:15:10 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 1073741824" returned: 0 in 0.714s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:10 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 Sep 28 16:15:10 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:10 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1" returned: 0 in 0.388s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d41411-fee0-4821-97e7-d05f7b72ed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84275daf-1783-4885-a5b0-5c195fa29aa1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd39898-430c-458f-aeee-b0387879ff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Volume volume-84275daf-1783-4885-a5b0-5c195fa29aa1 (84275daf-1783-4885-a5b0-5c195fa29aa1): created successfully Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd39898-430c-458f-aeee-b0387879ff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Flow 'volume_create_manager' (07c93e75-7643-4fb8-a856-978b745f7e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b9f79fc4-65cb-4de5-a53f-40017beb9cea tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created volume successfully. Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-84275daf-1783-4885-a5b0-5c195fa29aa1-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:10 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-84275daf-1783-4885-a5b0-5c195fa29aa1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-quobyte-84275daf-1783-4885-a5b0-5c195fa29aa1" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-84275daf-1783-4885-a5b0-5c195fa29aa1" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7feb3e-2984-4f05-a082-36bead33d933]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:11 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 Sep 28 16:15:11 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:11 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1" returned: 0 in 0.504s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:11 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1 Sep 28 16:15:11 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:12 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-84275daf-1783-4885-a5b0-5c195fa29aa1" returned: 0 in 0.393s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-84275daf-1783-4885-a5b0-5c195fa29aa1" released by "delete_volume" :: held 0.965s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created reservations ['4753f54c-5482-41a3-b3c0-333351db055a', '5010c204-d40e-469b-b908-31bcb28d3145', 'b82799fc-c3a3-49a0-8574-5fba0d10383a', '7852dea2-7506-4d7e-9ac1-b029ec0ace8a'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:12 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:12 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:12 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.328s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Deleted volume successfully. Sep 28 16:15:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d60466a2-7cb2-48b4-abb6-ac0ba58b48ba tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-84275daf-1783-4885-a5b0-5c195fa29aa1-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-4b876306-19bb-42da-b15b-ef676696abc2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-4b876306-19bb-42da-b15b-ef676696abc2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-quobyte-4b876306-19bb-42da-b15b-ef676696abc2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-4b876306-19bb-42da-b15b-ef676696abc2" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c95c47-3b74-48ca-a112-d12b390aff54]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:13 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 Sep 28 16:15:13 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:14 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2" returned: 0 in 0.706s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:14 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2 Sep 28 16:15:14 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:14 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4b876306-19bb-42da-b15b-ef676696abc2" returned: 0 in 0.386s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-4b876306-19bb-42da-b15b-ef676696abc2" released by "delete_volume" :: held 1.161s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created reservations ['a32f9d4b-4a87-4c6b-a3f8-8fd8e0686f52', '80308d5b-5d82-4f41-969e-dde09cfb21a2', 'bb5de00d-4474-4f18-be35-4fb3fdaf2386', '4f31e43d-4935-4bfc-8ab2-a04b1c4d8008'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:14 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:14 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:15 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.286s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Deleted volume successfully. Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9ea35fc2-ed64-42d2-9a06-edab460becd4 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-4b876306-19bb-42da-b15b-ef676696abc2-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-7c211927-7f7e-40f8-8b6d-24c3446bcd93-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-7c211927-7f7e-40f8-8b6d-24c3446bcd93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-quobyte-7c211927-7f7e-40f8-8b6d-24c3446bcd93" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-7c211927-7f7e-40f8-8b6d-24c3446bcd93" acquired by "delete_volume" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fda378-57ae-4b7b-9a18-57395c0b629e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:15 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 Sep 28 16:15:15 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:16 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:16 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93 Sep 28 16:15:16 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:16 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7c211927-7f7e-40f8-8b6d-24c3446bcd93" returned: 0 in 0.311s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-7c211927-7f7e-40f8-8b6d-24c3446bcd93" released by "delete_volume" :: held 0.789s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created reservations ['efb51bec-43be-4c74-a50c-250df89775f9', '9a8e99b5-53ad-49a0-8de6-3432646c5efa', '6f533ad5-4b6e-47ed-a230-d386be096587', '5ed3717b-8499-45a6-b170-444c98f5f669'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:16 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:16 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-cd0ad4cc-44e1-426c-b838-b9584bf56576-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-cd0ad4cc-44e1-426c-b838-b9584bf56576-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-quobyte-cd0ad4cc-44e1-426c-b838-b9584bf56576" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-cd0ad4cc-44e1-426c-b838-b9584bf56576" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c3aed-0be1-4fd2-bc5a-0680d9aff012]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:17 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.327s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Deleted volume successfully. Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48f27ebb-05fa-4ef0-a4b2-d1a7a4f42b86 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-7c211927-7f7e-40f8-8b6d-24c3446bcd93-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:17 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 Sep 28 16:15:17 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:17 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576" returned: 0 in 0.471s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:17 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576 Sep 28 16:15:17 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:17 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cd0ad4cc-44e1-426c-b838-b9584bf56576" returned: 0 in 0.289s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-cd0ad4cc-44e1-426c-b838-b9584bf56576" released by "delete_volume" :: held 0.817s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created reservations ['06fc9e6c-8efc-428b-8eb3-974288ecd997', 'eaa1b7b3-8ad5-459d-bc1e-117009a10c50', '3b64179c-3652-4e61-8d40-8e157d153a51', 'd5a240f6-7856-4c9f-952f-a4643d66610c'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:18 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:18 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-e9a41173-e4b9-444e-8e46-dff0960c827a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-e9a41173-e4b9-444e-8e46-dff0960c827a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-quobyte-e9a41173-e4b9-444e-8e46-dff0960c827a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-e9a41173-e4b9-444e-8e46-dff0960c827a" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d08cef-80e0-4221-9abb-a722250419a8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:18 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.379s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Deleted volume successfully. Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-36fac0fc-6b25-45ee-bb69-221cf5ea205b tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-cd0ad4cc-44e1-426c-b838-b9584bf56576-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:18 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a Sep 28 16:15:18 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:18 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a" returned: 0 in 0.548s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:18 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a Sep 28 16:15:18 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:19 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e9a41173-e4b9-444e-8e46-dff0960c827a" returned: 0 in 0.276s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-e9a41173-e4b9-444e-8e46-dff0960c827a" released by "delete_volume" :: held 0.882s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created reservations ['52bee6b5-d79d-4f65-a916-789188da3f3f', '58518141-3d61-47d8-9983-a9010719e415', 'f4be9789-2c8d-4398-a051-facf616c9906', '381eb0a8-3b1a-40ca-85b4-2cbfc263b3c2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:19 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:19 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-0cc33754-1138-4731-a877-d703185bb628-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-0cc33754-1138-4731-a877-d703185bb628-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "cinder-quobyte-0cc33754-1138-4731-a877-d703185bb628" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-0cc33754-1138-4731-a877-d703185bb628" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff678ba-9c59-42f6-b328-44388b853f7e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:19 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 Sep 28 16:15:19 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:19 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.403s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Deleted volume successfully. Sep 28 16:15:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2529b5a2-180a-40ee-8200-bbd802c7d820 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-e9a41173-e4b9-444e-8e46-dff0960c827a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:20 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628" returned: 0 in 0.467s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:20 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628 Sep 28 16:15:20 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:20 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0cc33754-1138-4731-a877-d703185bb628" returned: 0 in 0.263s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-quobyte-0cc33754-1138-4731-a877-d703185bb628" released by "delete_volume" :: held 0.790s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Created reservations ['20bc9c4b-1bc4-419d-be2c-38615d3fd294', 'c5d35a06-e984-420c-ae18-6496276d0c92', '345bc744-616e-4b95-9b69-f537295c7878', 'cae642cb-6f89-4167-b70b-d7605d54afa1'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:20 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:20 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:20 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.353s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:20 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Deleted volume successfully. Sep 28 16:15:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fd8b1c77-86f9-4267-aac9-2b42ffa88fe1 tempest-CreateVolumesFromSourceVolumeTest-1790120196 None] Lock "cinder-0cc33754-1138-4731-a877-d703185bb628-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:26 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:15:26 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:27 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:15:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:15:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:15:30 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=63,cinder:SELECT=34,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:30 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=81,cinder:UPDATE=89,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-38edae1d-1759-4b93-ba39-95238478c734 req-f749949c-ea16-47d5-be4c-680c918147be tempest-TestShelveInstance-1967532999 None] Terminate volume connection completed successfully. Sep 28 16:15:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-38edae1d-1759-4b93-ba39-95238478c734 req-f749949c-ea16-47d5-be4c-680c918147be tempest-TestShelveInstance-1967532999 None] Deleting attachment 26096b73-17d4-454e-a979-cf579e8ecbc7. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:15:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-7f0001f7-cdc5-4810-adf8-8c7fc51d0f66 req-5369fbaa-2519-468b-8dd2-592e6fe641a3 tempest-TestShelveInstance-1967532999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-7f0001f7-cdc5-4810-adf8-8c7fc51d0f66 req-5369fbaa-2519-468b-8dd2-592e6fe641a3 tempest-TestShelveInstance-1967532999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-7f0001f7-cdc5-4810-adf8-8c7fc51d0f66 req-5369fbaa-2519-468b-8dd2-592e6fe641a3 tempest-TestShelveInstance-1967532999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:55 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-7f0001f7-cdc5-4810-adf8-8c7fc51d0f66 req-5369fbaa-2519-468b-8dd2-592e6fe641a3 tempest-TestShelveInstance-1967532999 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be', 'name': 'volume-32e780a6-464e-4da6-9f57-4a17babea8c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dca9e85-8878-4100-94b4-3f9d2414fa24', 'enforce_multipath': True} {{(pid=86628) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:15:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-7f0001f7-cdc5-4810-adf8-8c7fc51d0f66 req-5369fbaa-2519-468b-8dd2-592e6fe641a3 tempest-TestShelveInstance-1967532999 None] attachment_update completed successfully. Sep 28 16:16:05 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:05 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:26 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:16:26 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:27 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.270s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:16:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:16:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:16:41 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-f26816d0-5726-456a-956a-9a7c2bc8785f tempest-TestShelveInstance-1967532999 None] Terminate volume connection completed successfully. Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-f26816d0-5726-456a-956a-9a7c2bc8785f tempest-TestShelveInstance-1967532999 None] Deleting attachment 7dca9e85-8878-4100-94b4-3f9d2414fa24. {{(pid=86628) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Acquiring lock "cinder-32e780a6-464e-4da6-9f57-4a17babea8c3-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Lock "cinder-32e780a6-464e-4da6-9f57-4a17babea8c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Acquiring lock "cinder-quobyte-32e780a6-464e-4da6-9f57-4a17babea8c3" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Lock "cinder-quobyte-32e780a6-464e-4da6-9f57-4a17babea8c3" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1db7ea0-1752-450a-ae6d-21a1f2cd6ac0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:42 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 Sep 28 16:16:42 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:42 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3" returned: 0 in 0.476s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:42 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3 Sep 28 16:16:42 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:42 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-32e780a6-464e-4da6-9f57-4a17babea8c3" returned: 0 in 0.326s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Lock "cinder-quobyte-32e780a6-464e-4da6-9f57-4a17babea8c3" released by "delete_volume" :: held 0.871s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:42 devstack cinder-volume[86628]: DEBUG cinder.quota [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Created reservations ['21d25874-1c5e-4a87-a82d-fc6315f11a16', '9938e6cf-d3b4-48d9-99ea-4fb6d6c36b8d', 'e641a766-f54e-48fb-9b1b-8319001eb2b5', '2c8b8d6f-554c-4270-ad47-0be64434e181'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:43 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:16:43 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:43 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.262s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG cinder.manager [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:43 devstack cinder-volume[86628]: INFO cinder.volume.manager [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Deleted volume successfully. Sep 28 16:16:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [req-f1c1ed9a-5ca9-4f56-aa19-331f43cfd753 req-661f77d9-ee95-4823-9fa4-9db9276ab95c tempest-TestShelveInstance-1967532999 None] Lock "cinder-32e780a6-464e-4da6-9f57-4a17babea8c3-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:52 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Flow 'volume_create_manager' (cc600172-4ada-4471-a2d8-9522490c9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf1cc51-7dff-4022-a64e-3dfbcc0d596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf1cc51-7dff-4022-a64e-3dfbcc0d596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac5e5a0-c6c1-4b96-9624-3c875b42bd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9b79ced03149bdb2b3d83741eb8b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:00Z,use_quota=True,user_id='bd4e46c7828a42bcbaa44c57ee776bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a494e81-d3ea-40bf-8d70-2214e7d0f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a494e81-d3ea-40bf-8d70-2214e7d0f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea6558f-3d4c-4ced-82c5-a2f6748a69c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea6558f-3d4c-4ced-82c5-a2f6748a69c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eac5e5a0-c6c1-4b96-9624-3c875b42bd74', 'volume_name': 'volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74', 'volume_size': 1, 'image_id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5722943493c5365f53e9a94f535c5b97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd9b79ced03149bdb2b3d83741eb8b83', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '74c4d29d5f34e8287c71a4ecd56a4ccd3f8622631355738ff1850e629e4641af6f958628a59366a701c947fd5866482249424a80a6a7b182c3e92e09bd412620', 'id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'created_at': datetime.datetime(2026, 9, 28, 14, 16, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 16, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d/file', 'properties': {}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41c8567-797c-48a3-9410-9055fde10925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41c8567-797c-48a3-9410-9055fde10925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615dc003-bc9a-4287-97d6-20d156f1f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Volume eac5e5a0-c6c1-4b96-9624-3c875b42bd74: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74', 'volume_size': 1, 'image_id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5722943493c5365f53e9a94f535c5b97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd9b79ced03149bdb2b3d83741eb8b83', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '74c4d29d5f34e8287c71a4ecd56a4ccd3f8622631355738ff1850e629e4641af6f958628a59366a701c947fd5866482249424a80a6a7b182c3e92e09bd412620', 'id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'created_at': datetime.datetime(2026, 9, 28, 14, 16, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 16, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d/file', 'properties': {}}, 'image_service': } Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Trying to clone eac5e5a0-c6c1-4b96-9624-3c875b42bd74 from image 926ed37c-7cb0-41dc-be71-0d6ad9d0159d at location (None, [{'url': 'file:///opt/stack/data/glance/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:17:00 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[23304250-1661-4598-836a-81b1cd7b97fd]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:01 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD Sep 28 16:17:01 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:01 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:01 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD Sep 28 16:17:01 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:01 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Temporary image 926ed37c-7cb0-41dc-be71-0d6ad9d0159d is fetched for user bd4e46c7828a42bcbaa44c57ee776bdb. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8bf504-346a-4e24-b82d-087febeabb1f]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:01 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD Sep 28 16:17:01 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:02 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:02 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD Sep 28 16:17:02 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:02 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac5e5a0-c6c1-4b96-9624-3c875b42bd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9b79ced03149bdb2b3d83741eb8b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:00Z,use_quota=True,user_id='bd4e46c7828a42bcbaa44c57ee776bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Creating volume eac5e5a0-c6c1-4b96-9624-3c875b42bd74 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:02 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:17:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:02 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 1073741824 Sep 28 16:17:02 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:03 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 1073741824" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:03 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 Sep 28 16:17:03 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:03 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" returned: 0 in 0.337s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Attempting download of 926ed37c-7cb0-41dc-be71-0d6ad9d0159d ((None, [{'url': 'file:///opt/stack/data/glance/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'metadata': {}}])) to volume eac5e5a0-c6c1-4b96-9624-3c875b42bd74. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f30ae-0d92-458a-8c17-5c21e1d84462]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:03 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj Sep 28 16:17:03 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:04 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj" returned: 0 in 0.407s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:04 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj Sep 28 16:17:04 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:04 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj" returned: 1 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_2sxn6aoj' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcbb6c5-359c-4106-a7bf-bc14b5119cb2]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:04 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD Sep 28 16:17:04 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:04 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:05 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD Sep 28 16:17:05 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:05 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] 926ed37c-7cb0-41dc-be71-0d6ad9d0159d was raw, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:05 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 Sep 28 16:17:05 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:05 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" returned: 0 in 0.548s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_926ed37c-7cb0-41dc-be71-0d6ad9d0159d_0kl4xawodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:17:05 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:17:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:05 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 1G Sep 28 16:17:05 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:06 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 1G" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Downloaded image 926ed37c-7cb0-41dc-be71-0d6ad9d0159d ((None, [{'url': 'file:///opt/stack/data/glance/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'metadata': {}}])) to volume eac5e5a0-c6c1-4b96-9624-3c875b42bd74 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Temporary image 926ed37c-7cb0-41dc-be71-0d6ad9d0159d for user bd4e46c7828a42bcbaa44c57ee776bdb is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Marking volume eac5e5a0-c6c1-4b96-9624-3c875b42bd74 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Copying metadata from image 926ed37c-7cb0-41dc-be71-0d6ad9d0159d to eac5e5a0-c6c1-4b96-9624-3c875b42bd74. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Creating volume glance metadata for volume eac5e5a0-c6c1-4b96-9624-3c875b42bd74 backed by image 926ed37c-7cb0-41dc-be71-0d6ad9d0159d with: {'image_id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5722943493c5365f53e9a94f535c5b97', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615dc003-bc9a-4287-97d6-20d156f1f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74', 'volume_size': 1, 'image_id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5722943493c5365f53e9a94f535c5b97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd9b79ced03149bdb2b3d83741eb8b83', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '74c4d29d5f34e8287c71a4ecd56a4ccd3f8622631355738ff1850e629e4641af6f958628a59366a701c947fd5866482249424a80a6a7b182c3e92e09bd412620', 'id': '926ed37c-7cb0-41dc-be71-0d6ad9d0159d', 'created_at': datetime.datetime(2026, 9, 28, 14, 16, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 16, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/926ed37c-7cb0-41dc-be71-0d6ad9d0159d/file', 'properties': {}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d3621-731b-4781-9882-da228bbf1d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Volume volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 (eac5e5a0-c6c1-4b96-9624-3c875b42bd74): created successfully Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d3621-731b-4781-9882-da228bbf1d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Flow 'volume_create_manager' (cc600172-4ada-4471-a2d8-9522490c9aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5e87c8e0-d1e9-4c25-be26-6f93fb0449eb tempest-VolumeImageDependencyTests-1324768158 None] Created volume successfully. Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Acquiring lock "cinder-eac5e5a0-c6c1-4b96-9624-3c875b42bd74-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Lock "cinder-eac5e5a0-c6c1-4b96-9624-3c875b42bd74-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Acquiring lock "cinder-quobyte-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Lock "cinder-quobyte-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155f4b2-bf1d-40be-a051-eb56eb32f4c9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:06 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 Sep 28 16:17:06 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:07 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" returned: 0 in 0.446s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:07 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74 Sep 28 16:17:07 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:07 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" returned: 0 in 0.400s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Lock "cinder-quobyte-eac5e5a0-c6c1-4b96-9624-3c875b42bd74" released by "delete_volume" :: held 0.898s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Created reservations ['7dd7a8ac-865a-418d-9e9b-a1de3f53d4b7', 'ab8267f9-6730-46f6-88ef-42b7d23e9618', '2437d24c-f7ce-46e7-bd5a-17c52878e840', '6e54c5f8-16bb-4268-b07a-50864bdd0785'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:07 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:17:07 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:08 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.337s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:08 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Deleted volume successfully. Sep 28 16:17:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-e5a94606-82c6-4b96-9e6a-e2152a697617 tempest-VolumeImageDependencyTests-1324768158 None] Lock "cinder-eac5e5a0-c6c1-4b96-9624-3c875b42bd74-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Flow 'volume_create_manager' (b47f6aa1-c4c6-4928-9975-7bd2a14ed6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d147b82e-99ec-4aa6-ae14-7067609c2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d147b82e-99ec-4aa6-ae14-7067609c2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eed0ac-2111-4d6b-bfbc-5f136f04ad28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7f4b879d614d5abcdfadf060ef7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:12Z,use_quota=True,user_id='b29f788b3e86496894ddc70233731596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5836d5-35c8-4a5e-a4b7-2f83621ad4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5836d5-35c8-4a5e-a4b7-2f83621ad4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56ab7a1-91ba-46c4-b905-0f3f7f94ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56ab7a1-91ba-46c4-b905-0f3f7f94ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eed0ac-2111-4d6b-bfbc-5f136f04ad28', 'volume_name': 'volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc4f3b8-ffec-4c50-80b1-7c6a8e00da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc4f3b8-ffec-4c50-80b1-7c6a8e00da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc164c2-392d-44f9-9319-50d640e64358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Volume d8eed0ac-2111-4d6b-bfbc-5f136f04ad28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28', 'volume_size': 1} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eed0ac-2111-4d6b-bfbc-5f136f04ad28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7f4b879d614d5abcdfadf060ef7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:12Z,use_quota=True,user_id='b29f788b3e86496894ddc70233731596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Creating volume d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:11 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:17:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:12 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 1073741824 Sep 28 16:17:12 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:12 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 1073741824" returned: 0 in 0.487s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:12 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 Sep 28 16:17:12 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:12 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28" returned: 0 in 0.303s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc164c2-392d-44f9-9319-50d640e64358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9ef82d-afb5-4c5d-8709-bd03ce621ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Volume volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 (d8eed0ac-2111-4d6b-bfbc-5f136f04ad28): created successfully Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9ef82d-afb5-4c5d-8709-bd03ce621ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Flow 'volume_create_manager' (b47f6aa1-c4c6-4928-9975-7bd2a14ed6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-77cf6e92-1a18-40ae-b9e1-1860996a4730 tempest-CinderUnicodeTest-730130337 None] Created volume successfully. Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Flow 'volume_create_manager' (1b459680-9b6a-4250-8c25-4de3d025fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4883a6-d344-4ba5-b55b-fe950ec26b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4883a6-d344-4ba5-b55b-fe950ec26b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-70676270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2ef470-429c-4f75-81db-9500e2ab29bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7f4b879d614d5abcdfadf060ef7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:14Z,use_quota=True,user_id='b29f788b3e86496894ddc70233731596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6550555d-9850-46c7-bd0d-e212d8157555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6550555d-9850-46c7-bd0d-e212d8157555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdf0c42-632f-4983-ba5f-79b63f12cd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdf0c42-632f-4983-ba5f-79b63f12cd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2ef470-429c-4f75-81db-9500e2ab29bf', 'volume_name': 'volume-bb2ef470-429c-4f75-81db-9500e2ab29bf', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaffe5a-3664-4314-a566-52dc18ad5921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaffe5a-3664-4314-a566-52dc18ad5921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef659d5-2db7-4dd3-bfb8-f480ef74711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:14 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Volume bb2ef470-429c-4f75-81db-9500e2ab29bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2ef470-429c-4f75-81db-9500e2ab29bf', 'volume_size': 1} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-70676270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2ef470-429c-4f75-81db-9500e2ab29bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c7f4b879d614d5abcdfadf060ef7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:14Z,use_quota=True,user_id='b29f788b3e86496894ddc70233731596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Creating volume bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:14 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:17:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:14 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf 1073741824 Sep 28 16:17:14 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:15 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf 1073741824" returned: 0 in 0.497s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:15 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf Sep 28 16:17:15 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:15 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf" returned: 0 in 0.269s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef659d5-2db7-4dd3-bfb8-f480ef74711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2ef470-429c-4f75-81db-9500e2ab29bf', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb606b6d-6de6-4b20-b7d9-251e33c0aea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:15 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Volume volume-bb2ef470-429c-4f75-81db-9500e2ab29bf (bb2ef470-429c-4f75-81db-9500e2ab29bf): created successfully Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb606b6d-6de6-4b20-b7d9-251e33c0aea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Flow 'volume_create_manager' (1b459680-9b6a-4250-8c25-4de3d025fc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fb5675b4-3fc8-4ba8-bcd2-874a4b6b1776 tempest-CinderUnicodeTest-730130337 None] Created volume successfully. Sep 28 16:17:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Creating offline snapshot 071ca600-94e8-4c8e-a18c-51274a48df44 of volume bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:17:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa644c0-084e-498c-9ee5-40864a0045d4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:17 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf Sep 28 16:17:17 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:17 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf" returned: 0 in 0.390s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:17 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 1G Sep 28 16:17:17 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:17 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 1G" returned: 0 in 0.481s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2ef470-429c-4f75-81db-9500e2ab29bf -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:17 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2ef470-429c-4f75-81db-9500e2ab29bf -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 Sep 28 16:17:17 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:18 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2ef470-429c-4f75-81db-9500e2ab29bf -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44" returned: 0 in 0.353s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:18 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 is being set with open permissions: ugo+rw Sep 28 16:17:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:18 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 Sep 28 16:17:18 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:18 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44" returned: 0 in 0.302s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:18 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info Sep 28 16:17:18 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:18 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info" returned: 0 in 0.309s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:18 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info is being set with open permissions: ugo+rw Sep 28 16:17:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:18 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info Sep 28 16:17:18 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:19 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.info" returned: 0 in 0.372s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a50e889e-b536-4240-ae89-62683c47ed4b tempest-CinderUnicodeTest-730130337 None] Create snapshot completed successfully Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-071ca600-94e8-4c8e-a18c-51274a48df44-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-071ca600-94e8-4c8e-a18c-51274a48df44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-quobyte-bb2ef470-429c-4f75-81db-9500e2ab29bf" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-bb2ef470-429c-4f75-81db-9500e2ab29bf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-quobyte-071ca600-94e8-4c8e-a18c-51274a48df44" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-071ca600-94e8-4c8e-a18c-51274a48df44" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Deleting offline snapshot 071ca600-94e8-4c8e-a18c-51274a48df44 of volume bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] snapshot_file for this snap is: volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5ca87b-941b-45a1-bbb6-b06e96b65eb8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:20 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 Sep 28 16:17:20 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:20 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44" returned: 0 in 0.431s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2ef470-429c-4f75-81db-9500e2ab29bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[45427d5a-a90f-4c8a-b1db-620e26a87a00]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:20 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf Sep 28 16:17:20 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:21 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf" returned: 0 in 0.447s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:21 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 Sep 28 16:17:21 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:21 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44" returned: 0 in 0.434s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:21 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44 Sep 28 16:17:21 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:21 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf.071ca600-94e8-4c8e-a18c-51274a48df44" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-071ca600-94e8-4c8e-a18c-51274a48df44" released by "_delete_snapshot" :: held 1.771s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-bb2ef470-429c-4f75-81db-9500e2ab29bf" released by "delete_snapshot" :: held 1.800s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Created reservations ['203de9e0-8037-40da-836d-fc0a88812eaa', 'cb370548-1995-4db8-94f2-8c2efba7632d', '1f3587ab-bea2-4b0d-9506-0a41e2b5139a', 'a01bf014-0e71-4f22-98c7-abbab511d508'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Delete snapshot completed successfully. Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-77564679-c084-4deb-8cee-75341d0a8ed9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-071ca600-94e8-4c8e-a18c-51274a48df44-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-bb2ef470-429c-4f75-81db-9500e2ab29bf-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-bb2ef470-429c-4f75-81db-9500e2ab29bf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-quobyte-bb2ef470-429c-4f75-81db-9500e2ab29bf" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-bb2ef470-429c-4f75-81db-9500e2ab29bf" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dd8df9-6e55-409d-b725-02befffedfde]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:22 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf Sep 28 16:17:22 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:22 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf" returned: 0 in 0.450s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:22 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf Sep 28 16:17:22 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:23 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-bb2ef470-429c-4f75-81db-9500e2ab29bf" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-bb2ef470-429c-4f75-81db-9500e2ab29bf" released by "delete_volume" :: held 0.852s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Created reservations ['ab4acfe2-0fea-4252-a735-ed05793c2bbd', '0ab929d5-0fb6-4e01-a880-134406a0ad74', 'f5f3965b-81cc-4e3f-afcb-da4ebcd8f642', 'e56cf333-c4eb-40d4-8794-3e8b61eeda4e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:23 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:17:23 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "cinder-quobyte-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d564698e-6826-439b-afce-83744b3c1977]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:23 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 Sep 28 16:17:23 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:23 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.387s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Deleted volume successfully. Sep 28 16:17:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d9e1444a-f4c9-41d9-8907-60d73e8b9ef9 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-bb2ef470-429c-4f75-81db-9500e2ab29bf-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:24 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28" returned: 0 in 0.463s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:24 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28 Sep 28 16:17:24 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:24 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28" returned: 0 in 0.351s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-quobyte-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28" released by "delete_volume" :: held 0.873s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Created reservations ['5b89449a-2764-4b50-9bf9-38a6688b062b', '1ae3a080-1546-4add-89de-a301fe325240', '722e8664-75f8-4f85-a306-26afe67f48b3', '8f9f9bcf-7faf-4961-9f3b-6bc162c22804'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:24 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:17:24 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:25 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.365s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:25 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Deleted volume successfully. Sep 28 16:17:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f9620562-73b5-440f-9e95-78ab88fb4c11 tempest-CinderUnicodeTest-730130337 None] Lock "cinder-d8eed0ac-2111-4d6b-bfbc-5f136f04ad28-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:26 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:17:26 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:27 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:17:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:17:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:17:34 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=39,cinder:SELECT=32,cinder:INSERT=22,cinder:DELETE=4 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:35 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=39,cinder:UPDATE=44,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Flow 'volume_create_manager' (2f578065-7982-4b58-b4e3-6b44aa32e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6a9967-b48c-48aa-83d1-d9646cf71a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6a9967-b48c-48aa-83d1-d9646cf71a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-567134810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db18b998-dcc7-4eba-96e9-17ee9f926697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724a5ec58b644db7b5438cd99cd307cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:58Z,use_quota=True,user_id='b194f11eaeae4466b96a3a01152bd9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04366bfb-bc2e-40c6-bf85-5e984765c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04366bfb-bc2e-40c6-bf85-5e984765c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ad77e9-e8ca-4ef4-a709-adc28126ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ad77e9-e8ca-4ef4-a709-adc28126ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db18b998-dcc7-4eba-96e9-17ee9f926697', 'volume_name': 'volume-db18b998-dcc7-4eba-96e9-17ee9f926697', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13498a94-c681-4352-bec1-37ace797abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13498a94-c681-4352-bec1-37ace797abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a7f03e-13fe-4239-9732-c634842c2077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Volume db18b998-dcc7-4eba-96e9-17ee9f926697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db18b998-dcc7-4eba-96e9-17ee9f926697', 'volume_size': 1} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-567134810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db18b998-dcc7-4eba-96e9-17ee9f926697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724a5ec58b644db7b5438cd99cd307cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:58Z,use_quota=True,user_id='b194f11eaeae4466b96a3a01152bd9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Creating volume db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:58 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 1073741824 Sep 28 16:17:58 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:58 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 1073741824" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:58 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 Sep 28 16:17:58 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:58 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697" returned: 0 in 0.331s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a7f03e-13fe-4239-9732-c634842c2077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db18b998-dcc7-4eba-96e9-17ee9f926697', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1755008b-367b-4000-9398-41bfc883424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Volume volume-db18b998-dcc7-4eba-96e9-17ee9f926697 (db18b998-dcc7-4eba-96e9-17ee9f926697): created successfully Sep 28 16:17:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1755008b-367b-4000-9398-41bfc883424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Flow 'volume_create_manager' (2f578065-7982-4b58-b4e3-6b44aa32e576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ce141aa7-e717-42f9-9257-4f631b92d80a tempest-SnapshotDependencyTests-1249572664 None] Created volume successfully. Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Creating offline snapshot eb8b3088-a3f6-4c28-995c-648b9c34140f of volume db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d58c8a-567b-4899-907d-f9cbce9c54ac]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:00 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 Sep 28 16:18:00 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:00 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697" returned: 0 in 0.393s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:00 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f 1G Sep 28 16:18:00 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:01 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f 1G" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db18b998-dcc7-4eba-96e9-17ee9f926697 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:01 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db18b998-dcc7-4eba-96e9-17ee9f926697 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f Sep 28 16:18:01 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:01 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db18b998-dcc7-4eba-96e9-17ee9f926697 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f" returned: 0 in 0.335s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:01 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f is being set with open permissions: ugo+rw Sep 28 16:18:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:01 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f Sep 28 16:18:01 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:01 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f" returned: 0 in 0.262s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:01 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info Sep 28 16:18:02 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:02 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info" returned: 0 in 0.286s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:02 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info is being set with open permissions: ugo+rw Sep 28 16:18:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:02 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info Sep 28 16:18:02 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:02 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.info" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1845d41d-5f2b-4473-ad92-978ea8478271 tempest-SnapshotDependencyTests-1249572664 None] Create snapshot completed successfully Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Flow 'volume_create_manager' (0d78430d-eebe-4e9a-87c6-4b6e5bbee084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c2e8e6-e73d-4cbb-af95-49b407b33c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c2e8e6-e73d-4cbb-af95-49b407b33c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d43f51-4e2f-41b0-8832-b08d9ad4eee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724a5ec58b644db7b5438cd99cd307cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb8b3088-a3f6-4c28-995c-648b9c34140f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:04Z,use_quota=True,user_id='b194f11eaeae4466b96a3a01152bd9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4d614c-14b3-4ce9-ae69-a7c4f6421258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4d614c-14b3-4ce9-ae69-a7c4f6421258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096cbacd-8e03-4e53-adc2-d71aa82a9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096cbacd-8e03-4e53-adc2-d71aa82a9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15d43f51-4e2f-41b0-8832-b08d9ad4eee2', 'volume_name': 'volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2', 'volume_size': 1, 'snapshot_id': 'eb8b3088-a3f6-4c28-995c-648b9c34140f'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe82b61-9623-439c-b519-f6f2be246b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe82b61-9623-439c-b519-f6f2be246b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de23dd5-e5a2-4b69-87ae-4103489b9afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Volume 15d43f51-4e2f-41b0-8832-b08d9ad4eee2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2', 'volume_size': 1, 'snapshot_id': 'eb8b3088-a3f6-4c28-995c-648b9c34140f'} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-quobyte-eb8b3088-a3f6-4c28-995c-648b9c34140f-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-eb8b3088-a3f6-4c28-995c-648b9c34140f-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Creating volume 15d43f51-4e2f-41b0-8832-b08d9ad4eee2 from snapshot eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-quobyte-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] snapshot: eb8b3088-a3f6-4c28-995c-648b9c34140f, volume: 15d43f51-4e2f-41b0-8832-b08d9ad4eee2, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75ebc11-2742-4ab8-bcb1-5cfe73832364]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:04 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f Sep 28 16:18:04 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:04 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f" returned: 0 in 0.415s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db18b998-dcc7-4eba-96e9-17ee9f926697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0455c719-16d7-47e2-a3ab-595bcbe2a417]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:05 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 Sep 28 16:18:05 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:05 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697" returned: 0 in 0.428s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:18:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:18:05 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:18:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:05 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 Sep 28 16:18:05 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:12 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" returned: 0 in 6.769s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:18:12 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Converted 1024.00 MB image at 151.24 MB/s Sep 28 16:18:12 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 is being set with open permissions: ugo+rw Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:12 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 Sep 28 16:18:12 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:12 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" returned: 0 in 0.302s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" released by "_copy_volume_from_snapshot" :: held 8.008s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-eb8b3088-a3f6-4c28-995c-648b9c34140f-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" released by "_create_volume_from_snapshot" :: held 8.084s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.102s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de23dd5-e5a2-4b69-87ae-4103489b9afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2', 'volume_size': 1, 'snapshot_id': 'eb8b3088-a3f6-4c28-995c-648b9c34140f'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc422e4-0deb-4bd3-9ac0-35eef34a3d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Volume volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 (15d43f51-4e2f-41b0-8832-b08d9ad4eee2): created successfully Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc422e4-0deb-4bd3-9ac0-35eef34a3d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Flow 'volume_create_manager' (0d78430d-eebe-4e9a-87c6-4b6e5bbee084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-445478ef-9e78-42ef-80bf-d3a7ac848e33 tempest-SnapshotDependencyTests-1249572664 None] Created volume successfully. Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-eb8b3088-a3f6-4c28-995c-648b9c34140f-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-eb8b3088-a3f6-4c28-995c-648b9c34140f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-quobyte-db18b998-dcc7-4eba-96e9-17ee9f926697" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-db18b998-dcc7-4eba-96e9-17ee9f926697" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-quobyte-eb8b3088-a3f6-4c28-995c-648b9c34140f" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-eb8b3088-a3f6-4c28-995c-648b9c34140f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Deleting offline snapshot eb8b3088-a3f6-4c28-995c-648b9c34140f of volume db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] snapshot_file for this snap is: volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b00e31-bc0d-4f6e-a060-7da71514bf9d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:13 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f Sep 28 16:18:13 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:14 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f" returned: 0 in 0.501s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db18b998-dcc7-4eba-96e9-17ee9f926697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:18:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2885a51-d9da-48cb-9167-af6cc0476110]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:14 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 Sep 28 16:18:14 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:14 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697" returned: 0 in 0.697s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:14 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f Sep 28 16:18:14 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:15 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:15 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f Sep 28 16:18:15 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:15 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697.eb8b3088-a3f6-4c28-995c-648b9c34140f" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-eb8b3088-a3f6-4c28-995c-648b9c34140f" released by "_delete_snapshot" :: held 2.115s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-db18b998-dcc7-4eba-96e9-17ee9f926697" released by "delete_snapshot" :: held 2.145s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Created reservations ['0b67ca5c-2b0f-40d1-afda-1a69dafaea4a', '06a143a0-6ba2-49ae-aa39-50805dfef6fc', '86ac7cb1-9b79-44c5-8ab6-f15a48badb3a', 'd335d040-8de7-4e59-9bcb-43fd89c3ed49'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Delete snapshot completed successfully. Sep 28 16:18:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5c1474e2-07ed-4ee4-bb36-eb999df86b13 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-eb8b3088-a3f6-4c28-995c-648b9c34140f-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-db18b998-dcc7-4eba-96e9-17ee9f926697-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-db18b998-dcc7-4eba-96e9-17ee9f926697-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-quobyte-db18b998-dcc7-4eba-96e9-17ee9f926697" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-db18b998-dcc7-4eba-96e9-17ee9f926697" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f3e76-c9b8-4dcd-af2f-1718586e0f9a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:17 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 Sep 28 16:18:17 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:17 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697" returned: 0 in 0.462s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:17 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697 Sep 28 16:18:17 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:17 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-db18b998-dcc7-4eba-96e9-17ee9f926697" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-db18b998-dcc7-4eba-96e9-17ee9f926697" released by "delete_volume" :: held 0.866s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Created reservations ['3c151ea4-cfb2-45be-8133-3c2c3f9a2515', 'fb283ac8-6d76-4c5a-bd44-2fa079e8ca5c', 'f8e42308-db9b-4c4d-abaa-6760744f87db', '2b0d84b0-5fd7-4118-9b59-04348a1f18bb'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:17 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:18:17 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-15d43f51-4e2f-41b0-8832-b08d9ad4eee2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-15d43f51-4e2f-41b0-8832-b08d9ad4eee2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "cinder-quobyte-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[215fb116-8fcd-44f3-9ba6-a67be441844f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:18 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.359s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:18 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 Sep 28 16:18:18 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Deleted volume successfully. Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-bc7bb38c-264b-4d64-8140-da2a65247aa3 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-db18b998-dcc7-4eba-96e9-17ee9f926697-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:18 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" returned: 0 in 0.436s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:18 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2 Sep 28 16:18:18 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:18 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" returned: 0 in 0.290s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-quobyte-15d43f51-4e2f-41b0-8832-b08d9ad4eee2" released by "delete_volume" :: held 0.782s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Created reservations ['d07dcb93-a8b3-48b5-acd6-ce63b505b36f', 'dc9d9307-dd0e-438d-b2c2-c16c960341b3', '76509338-c5f6-4eea-8a06-94b193ae763e', '0d29b66c-c8d4-46db-b6e8-ac8d153095b1'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:19 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:18:19 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:19 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.327s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:19 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Deleted volume successfully. Sep 28 16:18:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3d9b0f7f-22c4-4c11-a829-01a59851c6e6 tempest-SnapshotDependencyTests-1249572664 None] Lock "cinder-15d43f51-4e2f-41b0-8832-b08d9ad4eee2-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:26 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:18:26 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:27 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.271s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:18:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:18:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:18:28 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:29 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (f34e08fb-0dbb-43f2-b4ef-b2474e2f8547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37dc980-3e04-4686-ae24-a35c311005ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37dc980-3e04-4686-ae24-a35c311005ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423079308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:47Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a098326-d6c4-422b-9ed9-ceedf57bbe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a098326-d6c4-422b-9ed9-ceedf57bbe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28712e59-f90f-4f9a-adc4-25a2c3c387f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28712e59-f90f-4f9a-adc4-25a2c3c387f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38', 'volume_name': 'volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3094d581-3a1d-4caa-ad80-450f94083186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3094d581-3a1d-4caa-ad80-450f94083186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736e4c6b-0296-4e72-9ba3-4db0d0fdc987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume 0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38', 'volume_size': 1} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423079308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:47Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating volume 0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:47 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:47 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 1073741824 Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:47 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (f2a40b80-c9a1-4fa0-aaa8-785aa79164b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e81df5-45e1-4550-8231-55cf10b0cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e81df5-45e1-4550-8231-55cf10b0cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262685560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6257800-cf34-4944-b67e-5925b56cbaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:47Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c8baf0-783b-4141-a526-9fd3203be97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c8baf0-783b-4141-a526-9fd3203be97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f85d34-0ae9-4363-ad33-0069c061815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f85d34-0ae9-4363-ad33-0069c061815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6257800-cf34-4944-b67e-5925b56cbaff', 'volume_name': 'volume-c6257800-cf34-4944-b67e-5925b56cbaff', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f03412-c1e6-4ee3-ac74-7759f47ce221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f03412-c1e6-4ee3-ac74-7759f47ce221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c8fb59-3955-48c6-ad09-5b5e705df4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Volume c6257800-cf34-4944-b67e-5925b56cbaff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6257800-cf34-4944-b67e-5925b56cbaff', 'volume_size': 1} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (0f4f4f6c-7891-4e60-bcb0-115cec4e75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e3f356-9312-44b5-9325-bbe11d3df104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e3f356-9312-44b5-9325-bbe11d3df104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677649279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56573e96-8808-4394-842a-a6ff7bf6ad52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:48Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ad7f5d-694b-421c-b64c-7e3ed949288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ad7f5d-694b-421c-b64c-7e3ed949288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91eaceb0-3a7b-4d46-a3c9-7826facad5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91eaceb0-3a7b-4d46-a3c9-7826facad5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56573e96-8808-4394-842a-a6ff7bf6ad52', 'volume_name': 'volume-56573e96-8808-4394-842a-a6ff7bf6ad52', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba00734-32ea-413b-a1dd-ec493093bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba00734-32ea-413b-a1dd-ec493093bd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c78b7ce-f0de-40d8-a471-0d03270826be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Volume 56573e96-8808-4394-842a-a6ff7bf6ad52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56573e96-8808-4394-842a-a6ff7bf6ad52', 'volume_size': 1} Sep 28 16:18:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:48 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 1073741824" returned: 0 in 0.843s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:48 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 Sep 28 16:18:48 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (52eaa25b-790b-4f64-bf97-8e1e6d2475b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113ea0b0-b56e-4b5e-8743-204c27ee2151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113ea0b0-b56e-4b5e-8743-204c27ee2151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-420098018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c718fb06-6f54-4b49-b87a-fc92a8cfa715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:48Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ba645-b2ea-44eb-bbaf-e2f1b11eceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ba645-b2ea-44eb-bbaf-e2f1b11eceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f41d286-559f-4fd6-9a54-8a81aa253970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f41d286-559f-4fd6-9a54-8a81aa253970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c718fb06-6f54-4b49-b87a-fc92a8cfa715', 'volume_name': 'volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8a8bb0-6361-4ce8-b5d1-db03c89266e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8a8bb0-6361-4ce8-b5d1-db03c89266e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe5e30-33c5-415e-a2f8-a5695169f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:48 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Volume c718fb06-6f54-4b49-b87a-fc92a8cfa715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715', 'volume_size': 1} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:48 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" returned: 0 in 0.576s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262685560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6257800-cf34-4944-b67e-5925b56cbaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:47Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Creating volume c6257800-cf34-4944-b67e-5925b56cbaff {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:48 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:48 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff 1073741824 Sep 28 16:18:48 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736e4c6b-0296-4e72-9ba3-4db0d0fdc987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91148846-8c9a-42bc-a345-11ead6632668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 (0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38): created successfully Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91148846-8c9a-42bc-a345-11ead6632668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (f34e08fb-0dbb-43f2-b4ef-b2474e2f8547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-dac35968-9d49-4416-95a5-f906acc718d0 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created volume successfully. Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (5565c8cb-bbbf-4892-8ad0-f4873dd47fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53721450-9d64-4aea-85a7-b4d4c7f50066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53721450-9d64-4aea-85a7-b4d4c7f50066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852774887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c443e7-95bb-4f72-ba31-de2875cecb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:49Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693e6e88-7696-47ac-a373-a67e6d8425bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693e6e88-7696-47ac-a373-a67e6d8425bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49a755e-b547-448a-86c9-5a69e15ce1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49a755e-b547-448a-86c9-5a69e15ce1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c443e7-95bb-4f72-ba31-de2875cecb1e', 'volume_name': 'volume-46c443e7-95bb-4f72-ba31-de2875cecb1e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45011e9f-c0af-4868-b688-85d78bdb8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45011e9f-c0af-4868-b688-85d78bdb8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94417ba-b0c6-4edf-9205-1ef7dea559a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Volume 46c443e7-95bb-4f72-ba31-de2875cecb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c443e7-95bb-4f72-ba31-de2875cecb1e', 'volume_size': 1} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:49 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff 1073741824" returned: 0 in 1.020s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:49 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff Sep 28 16:18:49 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (efd2d0cb-e4e0-40d5-af01-3246fe369e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e4bf5c-ac0e-46c4-a047-be8c9a81d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e4bf5c-ac0e-46c4-a047-be8c9a81d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066462440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ebb272-cfcb-45ae-bc9d-2eff37190ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:50Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9277f210-c016-45ee-b3d6-6a7a6d964b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9277f210-c016-45ee-b3d6-6a7a6d964b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd114b0-da23-4573-829a-7a5ed936aa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd114b0-da23-4573-829a-7a5ed936aa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ebb272-cfcb-45ae-bc9d-2eff37190ea5', 'volume_name': 'volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d004bb7d-1a48-41c8-a10f-96d0d2b3712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d004bb7d-1a48-41c8-a10f-96d0d2b3712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21708c12-7913-4d17-9905-098c79f3f19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Volume 64ebb272-cfcb-45ae-bc9d-2eff37190ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5', 'volume_size': 1} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:50 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff" returned: 0 in 0.412s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677649279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56573e96-8808-4394-842a-a6ff7bf6ad52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:48Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Creating volume 56573e96-8808-4394-842a-a6ff7bf6ad52 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:50 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c8fb59-3955-48c6-ad09-5b5e705df4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6257800-cf34-4944-b67e-5925b56cbaff', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d117c4b4-2663-4a1a-8c0d-f4c46bbc009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:50 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 1073741824 Sep 28 16:18:50 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Volume volume-c6257800-cf34-4944-b67e-5925b56cbaff (c6257800-cf34-4944-b67e-5925b56cbaff): created successfully Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d117c4b4-2663-4a1a-8c0d-f4c46bbc009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (f2a40b80-c9a1-4fa0-aaa8-785aa79164b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b9fd08f5-ced3-4f94-8d60-73c217e87463 tempest-CreateVolumesFromImageTest-1795717279 None] Created volume successfully. Sep 28 16:18:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:51 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 1073741824" returned: 0 in 0.833s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:51 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 Sep 28 16:18:51 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:51 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52" returned: 0 in 0.286s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.896s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-420098018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c718fb06-6f54-4b49-b87a-fc92a8cfa715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:48Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Creating volume c718fb06-6f54-4b49-b87a-fc92a8cfa715 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:51 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c78b7ce-f0de-40d8-a471-0d03270826be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56573e96-8808-4394-842a-a6ff7bf6ad52', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:51 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 1073741824 Sep 28 16:18:51 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70690ee6-417e-4885-9ef1-38c56edccdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:51 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Volume volume-56573e96-8808-4394-842a-a6ff7bf6ad52 (56573e96-8808-4394-842a-a6ff7bf6ad52): created successfully Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70690ee6-417e-4885-9ef1-38c56edccdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:51 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (0f4f4f6c-7891-4e60-bcb0-115cec4e75b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-58c7eb86-9639-4202-a77d-23972ec7249f tempest-CreateVolumesFromImageTest-1795717279 None] Created volume successfully. Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Flow 'volume_create_manager' (5ec427ba-32e9-476d-803c-daef6962d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c361b26c-204f-4fd9-9d0b-0cc268ccd34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c361b26c-204f-4fd9-9d0b-0cc268ccd34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e66b70-c332-4b14-8a07-f8138c6b3cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b65c9d1e60434f950d01051af55976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:52Z,use_quota=True,user_id='35d4d7eb52fa4572b2e05c7dfe1350fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496accb2-e581-4c5a-8f5c-290e5346779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:52 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496accb2-e581-4c5a-8f5c-290e5346779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232d39b9-1962-4d3f-afd2-2b2b407d759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 1073741824" returned: 0 in 0.697s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:52 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 Sep 28 16:18:52 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232d39b9-1962-4d3f-afd2-2b2b407d759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5e66b70-c332-4b14-8a07-f8138c6b3cc4', 'volume_name': 'volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4', 'volume_size': 1, 'image_id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38ee71b5c062e3d30f05e70189f919cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6b65c9d1e60434f950d01051af55976', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98ad1f37776f0195147ddbf53086ab3b5897fcc68ba3483f879338c3cab807da66a210f561210e6b4a59d27c54c63a2091966d226f711206432a5d29a9b37620', 'id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1/file', 'properties': {}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69aa9dde-873b-4a93-86fb-c629fe5e87ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69aa9dde-873b-4a93-86fb-c629fe5e87ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de405d6f-c562-4923-8085-1573a6b41fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:52 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Volume d5e66b70-c332-4b14-8a07-f8138c6b3cc4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4', 'volume_size': 1, 'image_id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38ee71b5c062e3d30f05e70189f919cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6b65c9d1e60434f950d01051af55976', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98ad1f37776f0195147ddbf53086ab3b5897fcc68ba3483f879338c3cab807da66a210f561210e6b4a59d27c54c63a2091966d226f711206432a5d29a9b37620', 'id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1/file', 'properties': {}}, 'image_service': } Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Trying to clone d5e66b70-c332-4b14-8a07-f8138c6b3cc4 from image 1a92a29d-a134-4696-a8fc-5d224f1b93a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:18:52 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715" returned: 0 in 0.313s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852774887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c443e7-95bb-4f72-ba31-de2875cecb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:49Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Creating volume 46c443e7-95bb-4f72-ba31-de2875cecb1e {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:52 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debe5e30-33c5-415e-a2f8-a5695169f826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:52 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e 1073741824 Sep 28 16:18:52 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70814a-f4f0-44f9-85ea-82a037233efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:18:52 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:18:52 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Volume volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 (c718fb06-6f54-4b49-b87a-fc92a8cfa715): created successfully Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70814a-f4f0-44f9-85ea-82a037233efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (52eaa25b-790b-4f64-bf97-8e1e6d2475b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:52 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f33c57e5-04df-469d-89e4-2b68a0e1791e tempest-CreateVolumesFromImageTest-1795717279 None] Created volume successfully. Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719ad3e-ab2b-4421-bc66-575cbb3252ff]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:52 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD Sep 28 16:18:52 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:53 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:53 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD Sep 28 16:18:53 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:53 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e 1073741824" returned: 0 in 0.735s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:53 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e Sep 28 16:18:53 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Flow 'volume_create_manager' (48a2c516-4d20-4fc8-983a-999f57c66c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cf3529-6571-44e3-bdf3-1020e24adca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cf3529-6571-44e3-bdf3-1020e24adca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e359aaa3-4d2f-4185-a923-64f6644825c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2918f25628b645669b230af1a58ffeb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:53Z,use_quota=True,user_id='cfbb00f7f2974e9cba1235acc1bc31d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a890047-41bb-486d-aceb-90deb86c5d47),volume_type_id=3a890047-41bb-486d-aceb-90deb86c5d47)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5ddfb2-f873-452c-a368-ed2a0e60e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5ddfb2-f873-452c-a368-ed2a0e60e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f942ccde-75c8-454d-9d88-86cd46398ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.image.glance [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Creating Keystone auth plugin from conf {{(pid=86628) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:18:53 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Temporary image 1a92a29d-a134-4696-a8fc-5d224f1b93a1 is fetched for user 35d4d7eb52fa4572b2e05c7dfe1350fd. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c940cc-2764-4a1b-8bf8-b3794ad8be57]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:53 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e" returned: 0 in 0.312s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.548s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066462440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ebb272-cfcb-45ae-bc9d-2eff37190ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fe12f5eef943f3b3feb1b7b73ee543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:50Z,use_quota=True,user_id='4ef892a0e52e402599dd33ea708e696d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Creating volume 64ebb272-cfcb-45ae-bc9d-2eff37190ea5 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:53 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:53 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 1073741824 Sep 28 16:18:53 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94417ba-b0c6-4edf-9205-1ef7dea559a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c443e7-95bb-4f72-ba31-de2875cecb1e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9df800-b947-4927-b6a1-b01d3eb9c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Volume volume-46c443e7-95bb-4f72-ba31-de2875cecb1e (46c443e7-95bb-4f72-ba31-de2875cecb1e): created successfully Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9df800-b947-4927-b6a1-b01d3eb9c923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (5565c8cb-bbbf-4892-8ad0-f4873dd47fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:53 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD Sep 28 16:18:53 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c9309bbf-a2ac-46c7-9f1c-cf8c1145d315 tempest-CreateVolumesFromImageTest-1795717279 None] Created volume successfully. Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f942ccde-75c8-454d-9d88-86cd46398ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e359aaa3-4d2f-4185-a923-64f6644825c0', 'volume_name': 'volume-e359aaa3-4d2f-4185-a923-64f6644825c0', 'volume_size': 1, 'image_id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cdfc3893-1c35-488b-9ee8-8797f09365bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'acce9d5d3487e95a05e3635bd60101b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2918f25628b645669b230af1a58ffeb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f87c9c7603f3718335cd0b96cdb40c2a4370e1a39cddc1f261d858f0fc425b90e224cfde0fc3eb715953a07e752c8decd40dac1cbfdaf03358f44effd848922', 'id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cdfc3893-1c35-488b-9ee8-8797f09365bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab49b903-97be-4a30-9aab-2bf9b4229b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab49b903-97be-4a30-9aab-2bf9b4229b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3a30c4-cf10-4444-b3f3-0f9ee2e49ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:53 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Volume e359aaa3-4d2f-4185-a923-64f6644825c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e359aaa3-4d2f-4185-a923-64f6644825c0', 'volume_size': 1, 'image_id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cdfc3893-1c35-488b-9ee8-8797f09365bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'acce9d5d3487e95a05e3635bd60101b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2918f25628b645669b230af1a58ffeb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f87c9c7603f3718335cd0b96cdb40c2a4370e1a39cddc1f261d858f0fc425b90e224cfde0fc3eb715953a07e752c8decd40dac1cbfdaf03358f44effd848922', 'id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cdfc3893-1c35-488b-9ee8-8797f09365bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Trying to clone e359aaa3-4d2f-4185-a923-64f6644825c0 from image cdfc3893-1c35-488b-9ee8-8797f09365bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/cdfc3893-1c35-488b-9ee8-8797f09365bd', 'metadata': {}}]). {{(pid=86628) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:18:53 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:18:53 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece41d77-662f-4df5-9de6-bfd7528dca24]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD Sep 28 16:18:54 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD Sep 28 16:18:54 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 1073741824" returned: 0 in 0.570s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 Sep 28 16:18:54 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD" returned: 1 in 0.484s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:54 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD Sep 28 16:18:54 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5" returned: 0 in 0.309s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.048s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating offline snapshot 6985007a-39e5-49b5-9254-866f18d8d976 of volume 0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21708c12-7913-4d17-9905-098c79f3f19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ea91d2-de89-45ae-a7dd-46b327c6459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7126b35e-0fbe-42f8-a3cf-644e442adc69]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:54 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Volume volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 (64ebb272-cfcb-45ae-bc9d-2eff37190ea5): created successfully Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ea91d2-de89-45ae-a7dd-46b327c6459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Flow 'volume_create_manager' (efd2d0cb-e4e0-40d5-af01-3246fe369e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-acea7700-d8a1-45da-96e9-7450ee184ba6 tempest-CreateVolumesFromImageTest-1795717279 None] Created volume successfully. Sep 28 16:18:54 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 Sep 28 16:18:54 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:54 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Temporary image cdfc3893-1c35-488b-9ee8-8797f09365bd is fetched for user cfbb00f7f2974e9cba1235acc1bc31d3. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[334495a1-9004-486d-8eb0-df17433d4128]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:55 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD Sep 28 16:18:55 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:55 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" returned: 0 in 0.430s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:55 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 1G Sep 28 16:18:55 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:55 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:55 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD Sep 28 16:18:55 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:55 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 1G" returned: 0 in 0.545s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:55 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 Sep 28 16:18:55 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-64ebb272-cfcb-45ae-bc9d-2eff37190ea5-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-64ebb272-cfcb-45ae-bc9d-2eff37190ea5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:55 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD" returned: 1 in 0.552s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-quobyte-64ebb272-cfcb-45ae-bc9d-2eff37190ea5" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-64ebb272-cfcb-45ae-bc9d-2eff37190ea5" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee723426-6780-4380-87bb-edafe9417d5a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 Sep 28 16:18:56 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:56 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976" returned: 0 in 0.497s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 is being set with open permissions: ugo+rw Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 Sep 28 16:18:56 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:56 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5" returned: 0 in 0.448s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5 Sep 28 16:18:56 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:56 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976" returned: 0 in 0.327s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info Sep 28 16:18:56 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:56 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-64ebb272-cfcb-45ae-bc9d-2eff37190ea5" returned: 0 in 0.301s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-64ebb272-cfcb-45ae-bc9d-2eff37190ea5" released by "delete_volume" :: held 0.808s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Created reservations ['468e46a4-183a-4e2d-b5c8-f10e1e6129be', 'f1fcbdfc-3cdd-4863-b4ee-a1a47fd143e1', '85244abb-de77-4c97-926c-00da55915885', 'ac1a9140-94f9-488a-9582-27d50fc5e390'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info" returned: 0 in 0.377s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info is being set with open permissions: ugo+rw Sep 28 16:18:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:18:56 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:57 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info Sep 28 16:18:57 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-46c443e7-95bb-4f72-ba31-de2875cecb1e-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-46c443e7-95bb-4f72-ba31-de2875cecb1e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-quobyte-46c443e7-95bb-4f72-ba31-de2875cecb1e" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-46c443e7-95bb-4f72-ba31-de2875cecb1e" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06a2b9c-e0f7-4021-aa71-73b8e45e8801]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:57 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Deleted volume successfully. Sep 28 16:18:57 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.info" returned: 0 in 0.335s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fcbd94eb-0b52-490c-8dbf-90250a9bdfd0 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-64ebb272-cfcb-45ae-bc9d-2eff37190ea5-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.716s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e66b70-c332-4b14-8a07-f8138c6b3cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b65c9d1e60434f950d01051af55976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:52Z,use_quota=True,user_id='35d4d7eb52fa4572b2e05c7dfe1350fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Creating volume d5e66b70-c332-4b14-8a07-f8138c6b3cc4 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:57 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:57 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e Sep 28 16:18:57 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 1073741824 Sep 28 16:18:57 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-09da8cf4-280b-4ce8-b614-7b2ee35db287 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Create snapshot completed successfully Sep 28 16:18:57 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:57 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e" returned: 0 in 0.487s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:57 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e Sep 28 16:18:57 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:57 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 1073741824" returned: 0 in 0.545s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:57 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 Sep 28 16:18:57 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:58 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-46c443e7-95bb-4f72-ba31-de2875cecb1e" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-46c443e7-95bb-4f72-ba31-de2875cecb1e" released by "delete_volume" :: held 0.901s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Created reservations ['9f4868a4-770f-46b4-863e-395d5bc6dc27', 'bec49267-e5ad-4ae0-b6db-d36792d9bd02', '5e78d903-ff98-40b8-8148-ea61de2fba1c', '584551eb-f194-45ef-8bb9-9d85cf2c52bf'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:58 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" returned: 0 in 0.438s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.465s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e359aaa3-4d2f-4185-a923-64f6644825c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2918f25628b645669b230af1a58ffeb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:53Z,use_quota=True,user_id='cfbb00f7f2974e9cba1235acc1bc31d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a890047-41bb-486d-aceb-90deb86c5d47),volume_type_id=3a890047-41bb-486d-aceb-90deb86c5d47)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Creating volume e359aaa3-4d2f-4185-a923-64f6644825c0 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:58 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 1073741824 Sep 28 16:18:58 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Attempting download of 1a92a29d-a134-4696-a8fc-5d224f1b93a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'metadata': {}}])) to volume d5e66b70-c332-4b14-8a07-f8138c6b3cc4. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:18:58 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:18:58 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3577b7-3a3c-4772-af70-0eb8d760036c]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:58 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw Sep 28 16:18:58 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:59 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.574s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (5eeee240-8a0c-4ceb-9df8-009979cef308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55981efb-0ded-4fee-8ed1-8b83cd2e4eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Deleted volume successfully. Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55981efb-0ded-4fee-8ed1-8b83cd2e4eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805060960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef81bd6a-516b-441d-8c92-08676685d681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:59Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3974ad-21db-432b-b7fa-5fdd13183859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3974ad-21db-432b-b7fa-5fdd13183859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea84ccae-97f4-4b91-9db8-6a7cfed3b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea84ccae-97f4-4b91-9db8-6a7cfed3b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef81bd6a-516b-441d-8c92-08676685d681', 'volume_name': 'volume-ef81bd6a-516b-441d-8c92-08676685d681', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1499da65-943c-4ccd-8356-6a2877cd78ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1499da65-943c-4ccd-8356-6a2877cd78ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b419b8d6-2e53-4837-bae0-8463f60de61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume ef81bd6a-516b-441d-8c92-08676685d681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef81bd6a-516b-441d-8c92-08676685d681', 'volume_size': 1} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b0f1be59-9573-458a-8394-f216b5dcbd57 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-46c443e7-95bb-4f72-ba31-de2875cecb1e-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:59 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:59 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw" returned: 0 in 0.684s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 1073741824" returned: 0 in 0.908s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:59 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 Sep 28 16:18:59 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:59 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw Sep 28 16:18:59 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-c718fb06-6f54-4b49-b87a-fc92a8cfa715-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-c718fb06-6f54-4b49-b87a-fc92a8cfa715-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-quobyte-c718fb06-6f54-4b49-b87a-fc92a8cfa715" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-c718fb06-6f54-4b49-b87a-fc92a8cfa715" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de06e8e-b12c-41be-9796-beb2ce7a09e8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:59 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (fbb77f9b-f3eb-4ff5-b59a-3e0ffcd73cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88af2ab6-aca8-4fc8-815a-8785347b2123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw" returned: 1 in 0.577s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a92a29d-a134-4696-a8fc-5d224f1b93a1_90qb3rqw' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5fcfbb-5582-4574-a20f-5478850bf1aa]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88af2ab6-aca8-4fc8-815a-8785347b2123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302321117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565f93d7-febf-4110-ad9c-4830420766d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:00Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8ed9b9-db01-4070-a9fd-7aa631a173d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8ed9b9-db01-4070-a9fd-7aa631a173d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 Sep 28 16:18:59 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4572be4b-ec40-45d0-8888-3ff909f93eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4572be4b-ec40-45d0-8888-3ff909f93eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565f93d7-febf-4110-ad9c-4830420766d2', 'volume_name': 'volume-565f93d7-febf-4110-ad9c-4830420766d2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada74e35-4c7d-4d6d-83e8-db896e7548e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada74e35-4c7d-4d6d-83e8-db896e7548e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74270467-585e-4832-9b6b-89bfd8eb61d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume 565f93d7-febf-4110-ad9c-4830420766d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565f93d7-febf-4110-ad9c-4830420766d2', 'volume_size': 1} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0" returned: 0 in 0.590s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805060960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef81bd6a-516b-441d-8c92-08676685d681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:59Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating volume ef81bd6a-516b-441d-8c92-08676685d681 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:00 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:00 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 1073741824 Sep 28 16:19:00 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:00 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD Sep 28 16:19:00 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Attempting download of cdfc3893-1c35-488b-9ee8-8797f09365bd ((None, [{'url': 'file:///opt/stack/data/glance/images/cdfc3893-1c35-488b-9ee8-8797f09365bd', 'metadata': {}}])) to volume e359aaa3-4d2f-4185-a923-64f6644825c0. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[164f201f-345e-4e5f-a86a-b40ad3c7c7b8]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:00 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l Sep 28 16:19:00 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:00 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715" returned: 0 in 0.605s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:00 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715 Sep 28 16:19:00 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:00 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (a6550c79-1dfe-4c19-82de-8246ae83be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902d57e0-c5ca-4108-a8ee-62b0d884814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:00 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD Sep 28 16:19:00 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902d57e0-c5ca-4108-a8ee-62b0d884814a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343426823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10f7951-5213-4125-9288-ca3bc4187a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:00Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dd455a-01f9-4c4f-a487-e6f58b4c2063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:00 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dd455a-01f9-4c4f-a487-e6f58b4c2063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bdcd68-46bc-4451-8250-76eecc6aa090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bdcd68-46bc-4451-8250-76eecc6aa090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10f7951-5213-4125-9288-ca3bc4187a34', 'volume_name': 'volume-f10f7951-5213-4125-9288-ca3bc4187a34', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1424695a-135c-4351-b482-c8bd3808e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1424695a-135c-4351-b482-c8bd3808e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd49273-0e7d-4912-845a-0c6be095ec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume f10f7951-5213-4125-9288-ca3bc4187a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10f7951-5213-4125-9288-ca3bc4187a34', 'volume_size': 1} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l" returned: 0 in 0.626s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:00 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 1073741824" returned: 0 in 0.894s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:00 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c718fb06-6f54-4b49-b87a-fc92a8cfa715" returned: 0 in 0.571s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-c718fb06-6f54-4b49-b87a-fc92a8cfa715" released by "delete_volume" :: held 1.321s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:01 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l Sep 28 16:19:01 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:01 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 Sep 28 16:19:01 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Created reservations ['9eefa826-8954-425c-b35b-d4f692bc6970', 'e517947e-92c7-40b9-afbc-083435fdebfa', '277b3980-e57d-4d95-a725-95d72d0ebdc4', 'f25da343-c535-4e07-9c0c-67defbe80c72'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:01 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD" returned: 1 in 0.714s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] 1a92a29d-a134-4696-a8fc-5d224f1b93a1 was raw, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:01 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 Sep 28 16:19:01 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (f88a0c29-ecb8-4776-adbe-eea23fa1640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f522f365-4e1b-4419-87f4-2a4c57fb7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f522f365-4e1b-4419-87f4-2a4c57fb7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495828263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5e09c2-759f-406b-9c53-af00f2f5142a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:01Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f9a764-44d6-4f31-9192-da0046880691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f9a764-44d6-4f31-9192-da0046880691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e4849-9f26-40da-a79d-3602fdfa0fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e4849-9f26-40da-a79d-3602fdfa0fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5e09c2-759f-406b-9c53-af00f2f5142a', 'volume_name': 'volume-dd5e09c2-759f-406b-9c53-af00f2f5142a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec4c552-ad05-4faf-92b8-123eb9a01c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec4c552-ad05-4faf-92b8-123eb9a01c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7a176f-eb50-430d-ab17-d51000da92cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume dd5e09c2-759f-406b-9c53-af00f2f5142a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5e09c2-759f-406b-9c53-af00f2f5142a', 'volume_size': 1} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:01 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:01 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l" returned: 1 in 0.748s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdfc3893-1c35-488b-9ee8-8797f09365bd_1f0v0a9l' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681" returned: 0 in 0.499s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f4d384-7737-4406-9606-4b83176abf3d]: (4, 'raw') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302321117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565f93d7-febf-4110-ad9c-4830420766d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:00Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating volume 565f93d7-febf-4110-ad9c-4830420766d2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:01 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:01 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:01 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:01 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 1073741824 Sep 28 16:19:01 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b419b8d6-2e53-4837-bae0-8463f60de61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef81bd6a-516b-441d-8c92-08676685d681', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9597079-1cec-4b5a-9dca-2982e8111837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume volume-ef81bd6a-516b-441d-8c92-08676685d681 (ef81bd6a-516b-441d-8c92-08676685d681): created successfully Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9597079-1cec-4b5a-9dca-2982e8111837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (5eeee240-8a0c-4ceb-9df8-009979cef308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8525ca69-2afd-4a5c-a90d-c06d7c8a4c2e tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created volume successfully. Sep 28 16:19:01 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD Sep 28 16:19:01 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-56573e96-8808-4394-842a-a6ff7bf6ad52-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:02 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.616s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-56573e96-8808-4394-842a-a6ff7bf6ad52-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:02 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Deleted volume successfully. Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-edbe8d46-0531-4b8e-86af-747e7ff8c137 tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-c718fb06-6f54-4b49-b87a-fc92a8cfa715-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-quobyte-56573e96-8808-4394-842a-a6ff7bf6ad52" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:02 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" returned: 0 in 1.090s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a92a29d-a134-4696-a8fc-5d224f1b93a1_w9je6zpwdevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:19:02 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-56573e96-8808-4394-842a-a6ff7bf6ad52" acquired by "delete_volume" :: waited 0.051s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:02 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 1G Sep 28 16:19:02 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:02 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e171438d-88d1-416d-8850-5c9814a695c9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (74f42d77-ba33-43f9-9e4c-d06b5405ed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59add86c-6cec-4310-bbb8-bb3c04e30ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59add86c-6cec-4310-bbb8-bb3c04e30ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322263066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf3741f-b4fd-4785-aaf4-66dcd147c360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:02Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25227197-2c98-42a4-8d63-92251a1dbbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25227197-2c98-42a4-8d63-92251a1dbbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc29b91-abd5-4959-8e30-6289dfba829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc29b91-abd5-4959-8e30-6289dfba829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf3741f-b4fd-4785-aaf4-66dcd147c360', 'volume_name': 'volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac9485c-131f-4b6f-be20-316d45bae7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac9485c-131f-4b6f-be20-316d45bae7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26035f4b-6ee1-42a6-9991-b8b2e511fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:02 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume cbf3741f-b4fd-4785-aaf4-66dcd147c360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360', 'volume_size': 1} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:02 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD Sep 28 16:19:02 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:02 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 Sep 28 16:19:02 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:02 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 1073741824" returned: 0 in 1.032s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:02 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 Sep 28 16:19:02 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:02 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 1G" returned: 0 in 0.452s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Downloaded image 1a92a29d-a134-4696-a8fc-5d224f1b93a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'metadata': {}}])) to volume d5e66b70-c332-4b14-8a07-f8138c6b3cc4 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Temporary image 1a92a29d-a134-4696-a8fc-5d224f1b93a1 for user 35d4d7eb52fa4572b2e05c7dfe1350fd is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Marking volume d5e66b70-c332-4b14-8a07-f8138c6b3cc4 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Copying metadata from image 1a92a29d-a134-4696-a8fc-5d224f1b93a1 to d5e66b70-c332-4b14-8a07-f8138c6b3cc4. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Creating volume glance metadata for volume d5e66b70-c332-4b14-8a07-f8138c6b3cc4 backed by image 1a92a29d-a134-4696-a8fc-5d224f1b93a1 with: {'image_id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38ee71b5c062e3d30f05e70189f919cc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de405d6f-c562-4923-8085-1573a6b41fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4', 'volume_size': 1, 'image_id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38ee71b5c062e3d30f05e70189f919cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6b65c9d1e60434f950d01051af55976', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98ad1f37776f0195147ddbf53086ab3b5897fcc68ba3483f879338c3cab807da66a210f561210e6b4a59d27c54c63a2091966d226f711206432a5d29a9b37620', 'id': '1a92a29d-a134-4696-a8fc-5d224f1b93a1', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a92a29d-a134-4696-a8fc-5d224f1b93a1/file', 'properties': {}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58e9662-589a-47aa-8ae9-6307cfac7982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:02 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Volume volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 (d5e66b70-c332-4b14-8a07-f8138c6b3cc4): created successfully Sep 28 16:19:02 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58e9662-589a-47aa-8ae9-6307cfac7982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Flow 'volume_create_manager' (5ec427ba-32e9-476d-803c-daef6962d763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD" returned: 1 in 0.551s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] cdfc3893-1c35-488b-9ee8-8797f09365bd was raw, converting to qcow2 {{(pid=86628) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:02 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52" returned: 0 in 0.558s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:03 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 Sep 28 16:19:03 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ed26f11e-3c81-4db9-8177-6b1404875e2d tempest-VolumeImageDependencyTests-1373874564 None] Created volume successfully. Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2" returned: 0 in 0.357s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.227s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343426823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10f7951-5213-4125-9288-ca3bc4187a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:00Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating volume f10f7951-5213-4125-9288-ca3bc4187a34 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:03 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52 Sep 28 16:19:03 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:03 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74270467-585e-4832-9b6b-89bfd8eb61d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565f93d7-febf-4110-ad9c-4830420766d2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b09b81-74cf-4c05-98d4-e44438c81bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:03 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 1073741824 Sep 28 16:19:03 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume volume-565f93d7-febf-4110-ad9c-4830420766d2 (565f93d7-febf-4110-ad9c-4830420766d2): created successfully Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b09b81-74cf-4c05-98d4-e44438c81bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (fbb77f9b-f3eb-4ff5-b59a-3e0ffcd73cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:03 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-958f7c77-6bae-45da-b409-c13b7a10c798 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created volume successfully. Sep 28 16:19:03 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-56573e96-8808-4394-842a-a6ff7bf6ad52" returned: 0 in 0.435s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-56573e96-8808-4394-842a-a6ff7bf6ad52" released by "delete_volume" :: held 1.089s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Acquiring lock "cinder-d5e66b70-c332-4b14-8a07-f8138c6b3cc4-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Lock "cinder-d5e66b70-c332-4b14-8a07-f8138c6b3cc4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Acquiring lock "cinder-quobyte-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Created reservations ['cafeb40d-a1a0-4ee5-ade8-60441c09f460', '1276d062-bf8d-4757-a4ab-d68777f7ea5b', '7d1fa516-db07-405c-ad3d-ac742deeea9c', '8b435738-817b-496b-89ce-21be874da0d2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Lock "cinder-quobyte-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" acquired by "delete_volume" :: waited 0.042s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc83c9b7-64d6-496f-9ed2-13b53fb910b4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:03 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 1073741824" returned: 0 in 0.719s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:03 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0" returned: 0 in 0.795s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cdfc3893-1c35-488b-9ee8-8797f09365bd__2q_tuo7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:19:03 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:03 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 1G Sep 28 16:19:03 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 Sep 28 16:19:03 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 Sep 28 16:19:03 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:04 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.285s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Deleted volume successfully. Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-50055b90-f550-442c-9208-dee2b71f98af tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-56573e96-8808-4394-842a-a6ff7bf6ad52-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:04 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34" returned: 0 in 0.304s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.636s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495828263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5e09c2-759f-406b-9c53-af00f2f5142a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:01Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating volume dd5e09c2-759f-406b-9c53-af00f2f5142a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:04 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:04 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd49273-0e7d-4912-845a-0c6be095ec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10f7951-5213-4125-9288-ca3bc4187a34', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b49f70-8efe-42e5-87b3-885a85a87719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:04 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a 1073741824 Sep 28 16:19:04 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" returned: 0 in 0.524s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume volume-f10f7951-5213-4125-9288-ca3bc4187a34 (f10f7951-5213-4125-9288-ca3bc4187a34): created successfully Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b49f70-8efe-42e5-87b3-885a85a87719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:04 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4 Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (a6550c79-1dfe-4c19-82de-8246ae83be5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:04 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 1G" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Downloaded image cdfc3893-1c35-488b-9ee8-8797f09365bd ((None, [{'url': 'file:///opt/stack/data/glance/images/cdfc3893-1c35-488b-9ee8-8797f09365bd', 'metadata': {}}])) to volume e359aaa3-4d2f-4185-a923-64f6644825c0 successfully. {{(pid=86628) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Temporary image cdfc3893-1c35-488b-9ee8-8797f09365bd for user cfbb00f7f2974e9cba1235acc1bc31d3 is deleted. {{(pid=86628) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.volume_utils [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Marking volume e359aaa3-4d2f-4185-a923-64f6644825c0 as bootable. {{(pid=86628) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:19:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d78e45d2-8994-48bb-ac70-fa0c216f8b81 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created volume successfully. Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Copying metadata from image cdfc3893-1c35-488b-9ee8-8797f09365bd to e359aaa3-4d2f-4185-a923-64f6644825c0. {{(pid=86628) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Creating volume glance metadata for volume e359aaa3-4d2f-4185-a923-64f6644825c0 backed by image cdfc3893-1c35-488b-9ee8-8797f09365bd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'acce9d5d3487e95a05e3635bd60101b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86628) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3a30c4-cf10-4444-b3f3-0f9ee2e49ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e359aaa3-4d2f-4185-a923-64f6644825c0', 'volume_size': 1, 'image_id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cdfc3893-1c35-488b-9ee8-8797f09365bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'acce9d5d3487e95a05e3635bd60101b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2918f25628b645669b230af1a58ffeb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4f87c9c7603f3718335cd0b96cdb40c2a4370e1a39cddc1f261d858f0fc425b90e224cfde0fc3eb715953a07e752c8decd40dac1cbfdaf03358f44effd848922', 'id': 'cdfc3893-1c35-488b-9ee8-8797f09365bd', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cdfc3893-1c35-488b-9ee8-8797f09365bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb94cfe-fdfa-4ab3-aaaa-97fba0392cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:04 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Volume volume-e359aaa3-4d2f-4185-a923-64f6644825c0 (e359aaa3-4d2f-4185-a923-64f6644825c0): created successfully Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb94cfe-fdfa-4ab3-aaaa-97fba0392cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Flow 'volume_create_manager' (48a2c516-4d20-4fc8-983a-999f57c66c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-967dde2e-8354-42dd-b46f-1823bc8107e8 tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Created volume successfully. Sep 28 16:19:04 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" returned: 0 in 0.329s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Lock "cinder-quobyte-d5e66b70-c332-4b14-8a07-f8138c6b3cc4" released by "delete_volume" :: held 0.908s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-c6257800-cf34-4944-b67e-5925b56cbaff-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-c6257800-cf34-4944-b67e-5925b56cbaff-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Created reservations ['b3023fce-889a-4e15-96c6-df835d2b4b56', 'aea4d949-414f-414d-9b77-a756d6fde6f0', '314b02b3-43b9-45d9-bd9d-5b7e360ae484', '398cfc6f-fdc9-44e3-b054-c37ee0ab78a8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "cinder-quobyte-c6257800-cf34-4944-b67e-5925b56cbaff" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-c6257800-cf34-4944-b67e-5925b56cbaff" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d6a273-d40b-482e-8989-41bc632e3d64]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:04 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a 1073741824" returned: 0 in 0.723s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Acquiring lock "cinder-e359aaa3-4d2f-4185-a923-64f6644825c0-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff Sep 28 16:19:04 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "cinder-e359aaa3-4d2f-4185-a923-64f6644825c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:04 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a Sep 28 16:19:04 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Acquiring lock "cinder-quobyte-e359aaa3-4d2f-4185-a923-64f6644825c0" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "cinder-quobyte-e359aaa3-4d2f-4185-a923-64f6644825c0" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15e594a-3b86-4869-aacf-5a1cae5b37d7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:05 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 Sep 28 16:19:05 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.486s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Deleted volume successfully. Sep 28 16:19:05 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff" returned: 0 in 0.565s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:05 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a" returned: 0 in 0.447s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.813s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322263066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf3741f-b4fd-4785-aaf4-66dcd147c360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d18f03991ae42cb8216008a312a3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:02Z,use_quota=True,user_id='50230be3355648bb89dcc6b789624dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Creating volume cbf3741f-b4fd-4785-aaf4-66dcd147c360 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:05 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff Sep 28 16:19:05 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7a176f-eb50-430d-ab17-d51000da92cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5e09c2-759f-406b-9c53-af00f2f5142a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:05 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 1073741824 Sep 28 16:19:05 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c04f964-e480-4580-8788-7b3eb7729562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-93b57109-3dbb-4d2e-876b-447add58f65b tempest-VolumeImageDependencyTests-1373874564 None] Lock "cinder-d5e66b70-c332-4b14-8a07-f8138c6b3cc4-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume volume-dd5e09c2-759f-406b-9c53-af00f2f5142a (dd5e09c2-759f-406b-9c53-af00f2f5142a): created successfully Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c04f964-e480-4580-8788-7b3eb7729562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (f88a0c29-ecb8-4776-adbe-eea23fa1640e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a3d4761b-1c07-4fa9-9eb3-43a5a40bb132 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created volume successfully. Sep 28 16:19:05 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0" returned: 0 in 0.712s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:05 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0 Sep 28 16:19:05 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c6257800-cf34-4944-b67e-5925b56cbaff" returned: 0 in 0.576s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-quobyte-c6257800-cf34-4944-b67e-5925b56cbaff" released by "delete_volume" :: held 1.232s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Created reservations ['61d1c394-8fed-4506-8869-1a8dd68b1038', 'b183e3c7-d8f4-4d8b-b47a-2b50e6be7d6d', '352b4fc8-3dea-4baa-8ed7-002a361a4f1b', '7005d51a-8fce-4973-8067-4bda1f2ceaaf'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 1073741824" returned: 0 in 0.830s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:06 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 Sep 28 16:19:06 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e359aaa3-4d2f-4185-a923-64f6644825c0" returned: 0 in 0.538s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "cinder-quobyte-e359aaa3-4d2f-4185-a923-64f6644825c0" released by "delete_volume" :: held 1.332s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Created reservations ['c065859b-e14b-4b1b-b3f0-b9259a3c217b', 'ff922651-6978-4cca-82c8-aeff72e23d95', 'b8579b84-9a9a-400e-9563-d7cabeb66812', '6a6fb87c-479d-416b-8176-55bc53eb1edb'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.377s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Deleted volume successfully. Sep 28 16:19:06 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:06 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-90ffb2d0-845c-4a6d-842a-2cbd6c64a52a tempest-CreateVolumesFromImageTest-1795717279 None] Lock "cinder-c6257800-cf34-4944-b67e-5925b56cbaff-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:06 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360" returned: 0 in 0.424s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26035f4b-6ee1-42a6-9991-b8b2e511fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02be5dfc-c9cf-45ec-a202-5047c5f00960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Volume volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 (cbf3741f-b4fd-4785-aaf4-66dcd147c360): created successfully Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02be5dfc-c9cf-45ec-a202-5047c5f00960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Flow 'volume_create_manager' (74f42d77-ba33-43f9-9e4c-d06b5405ed76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cac02e74-4be3-46ba-88b4-137e5f832a5b tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created volume successfully. Sep 28 16:19:06 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.348s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Deleted volume successfully. Sep 28 16:19:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7d199d1c-1323-4a4d-ba58-103fb29c1b1f tempest-VolumeAndVolumeTypeFromImageTest-616194324 None] Lock "cinder-e359aaa3-4d2f-4185-a923-64f6644825c0-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-cbf3741f-b4fd-4785-aaf4-66dcd147c360-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-cbf3741f-b4fd-4785-aaf4-66dcd147c360-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-cbf3741f-b4fd-4785-aaf4-66dcd147c360" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-cbf3741f-b4fd-4785-aaf4-66dcd147c360" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:07 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad4738-6ea5-4076-9ed0-6cb632d61343]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:07 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 Sep 28 16:19:07 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:08 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360" returned: 0 in 0.623s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:08 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360 Sep 28 16:19:08 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:08 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cbf3741f-b4fd-4785-aaf4-66dcd147c360" returned: 0 in 0.372s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-cbf3741f-b4fd-4785-aaf4-66dcd147c360" released by "delete_volume" :: held 1.075s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['ffc49c02-2f27-4bec-9b85-26dcefa05996', 'a1af7db4-0c6e-4c76-b286-4180d4370644', '31dee445-9e76-41f4-9a9a-50d0a053de0d', '431a86fe-c3ce-4e6d-9e3e-ef2c384244f6'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:08 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:08 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:09 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.316s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:09 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleted volume successfully. Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8d62af6a-7bb2-4d4c-9471-a36c22c5d1c7 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-cbf3741f-b4fd-4785-aaf4-66dcd147c360-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-dd5e09c2-759f-406b-9c53-af00f2f5142a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-dd5e09c2-759f-406b-9c53-af00f2f5142a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-dd5e09c2-759f-406b-9c53-af00f2f5142a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-dd5e09c2-759f-406b-9c53-af00f2f5142a" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:09 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c566f6e-e6da-4bd5-8b37-acd4e167df57]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:10 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a Sep 28 16:19:10 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:10 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a" returned: 0 in 0.680s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:10 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a Sep 28 16:19:10 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Flow 'volume_create_manager' (479ce0b1-1fa8-4a9c-be08-af5e52fe7f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6380b4-cda4-4128-a2d1-42a1d5e2fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6380b4-cda4-4128-a2d1-42a1d5e2fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dbd223-1fcc-4a77-a2a8-536334e0cff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe748c1ee5e428b957bdaeaafd8e07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:11Z,use_quota=True,user_id='3cb1b936433a4cfd9206da0f85fa5ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666a2933-932b-495a-a020-9198d7ca2e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666a2933-932b-495a-a020-9198d7ca2e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fe7b8c-da04-4b2b-b37e-7514cf119f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fe7b8c-da04-4b2b-b37e-7514cf119f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49dbd223-1fcc-4a77-a2a8-536334e0cff3', 'volume_name': 'volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50de262-fb70-4709-8da0-4eb0017eff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50de262-fb70-4709-8da0-4eb0017eff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6516ee5e-c395-4304-bf63-55385cce7074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Volume 49dbd223-1fcc-4a77-a2a8-536334e0cff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3', 'volume_size': 1} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dbd223-1fcc-4a77-a2a8-536334e0cff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe748c1ee5e428b957bdaeaafd8e07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:11Z,use_quota=True,user_id='3cb1b936433a4cfd9206da0f85fa5ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Creating volume 49dbd223-1fcc-4a77-a2a8-536334e0cff3 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:11 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:11 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 1073741824 Sep 28 16:19:11 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:11 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-dd5e09c2-759f-406b-9c53-af00f2f5142a" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-dd5e09c2-759f-406b-9c53-af00f2f5142a" released by "delete_volume" :: held 1.205s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['4642acf2-d27a-4a94-9cce-4fd40e46d254', '891a64f4-f2df-4188-97f2-a5d97f129057', 'fdef3959-28a7-4382-a4dc-46f0fe4f0fc7', '36f2cbde-1c95-4caf-b01d-0c6f6be3937d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:11 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:11 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:11 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 1073741824" returned: 0 in 0.693s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.372s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:11 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleted volume successfully. Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8dd030e1-8f11-48a8-be37-8732c377615c tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-dd5e09c2-759f-406b-9c53-af00f2f5142a-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:11 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 Sep 28 16:19:11 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:12 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6516ee5e-c395-4304-bf63-55385cce7074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2fc827-a7ef-46f5-9489-190e3d10182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (2cce092b-7318-471a-be8f-8f354c1ff28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ac8f0a-2898-4608-ab44-fc04a29ea9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Volume volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 (49dbd223-1fcc-4a77-a2a8-536334e0cff3): created successfully Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2fc827-a7ef-46f5-9489-190e3d10182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Flow 'volume_create_manager' (479ce0b1-1fa8-4a9c-be08-af5e52fe7f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ac8f0a-2898-4608-ab44-fc04a29ea9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-882877958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6ef356-a38a-4afc-9265-87d12eb5637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:12Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9e4eb3-ce32-4dff-a599-2387fd6b50fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9e4eb3-ce32-4dff-a599-2387fd6b50fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4678e4-c983-4277-b78e-cd3869b73c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4678e4-c983-4277-b78e-cd3869b73c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6ef356-a38a-4afc-9265-87d12eb5637d', 'volume_name': 'volume-4c6ef356-a38a-4afc-9265-87d12eb5637d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e60f1cb-648f-45c9-b9fe-f62190942984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e60f1cb-648f-45c9-b9fe-f62190942984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5312765-8c76-4263-ae1e-99e67caadf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume 4c6ef356-a38a-4afc-9265-87d12eb5637d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6ef356-a38a-4afc-9265-87d12eb5637d', 'volume_size': 1} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-882877958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6ef356-a38a-4afc-9265-87d12eb5637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:12Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Creating volume 4c6ef356-a38a-4afc-9265-87d12eb5637d {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:12 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-f10f7951-5213-4125-9288-ca3bc4187a34-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6fc49ba9-5824-4950-aec9-d34ef5a27a30 tempest-CinderUnicodeTest-1633096864 None] Created volume successfully. Sep 28 16:19:12 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d 1073741824 Sep 28 16:19:12 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-f10f7951-5213-4125-9288-ca3bc4187a34-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-f10f7951-5213-4125-9288-ca3bc4187a34" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-f10f7951-5213-4125-9288-ca3bc4187a34" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1fca30-1967-41c8-b849-49a8c6502b2a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:12 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 Sep 28 16:19:12 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:12 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d 1073741824" returned: 0 in 0.627s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:12 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:12 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34 Sep 28 16:19:12 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:13 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d Sep 28 16:19:13 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:13 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f10f7951-5213-4125-9288-ca3bc4187a34" returned: 0 in 0.380s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:13 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-f10f7951-5213-4125-9288-ca3bc4187a34" released by "delete_volume" :: held 0.947s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d" returned: 0 in 0.345s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5312765-8c76-4263-ae1e-99e67caadf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6ef356-a38a-4afc-9265-87d12eb5637d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee9eddd-3048-49ba-9a88-8fe511477c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume volume-4c6ef356-a38a-4afc-9265-87d12eb5637d (4c6ef356-a38a-4afc-9265-87d12eb5637d): created successfully Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee9eddd-3048-49ba-9a88-8fe511477c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (2cce092b-7318-471a-be8f-8f354c1ff28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-660ef555-b197-4f38-a58f-46609f3075fd tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created volume successfully. Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['2148714b-2357-4e63-b6ba-54f647b57200', 'b5a1f42e-1a5e-45e8-ae46-076fe223cca9', '09188600-4bd1-4505-bab5-5519d267c4ec', '5a9ea6ba-d3ff-403f-9397-6e5111913adb'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:13 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:13 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Flow 'volume_create_manager' (84f211eb-186b-48aa-82cb-6757e672b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c62de74-801f-4d90-8d04-a4119b13d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c62de74-801f-4d90-8d04-a4119b13d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-399182677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ff1e2-1cee-4745-8a11-26481efe5dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe748c1ee5e428b957bdaeaafd8e07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:14Z,use_quota=True,user_id='3cb1b936433a4cfd9206da0f85fa5ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98399a30-4355-488f-a927-970c0b045afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98399a30-4355-488f-a927-970c0b045afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c839ca-1d88-45f4-bfad-010681b7b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c839ca-1d88-45f4-bfad-010681b7b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3ff1e2-1cee-4745-8a11-26481efe5dc9', 'volume_name': 'volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e08b91a-0355-4fde-9f63-2bff7f8734a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e08b91a-0355-4fde-9f63-2bff7f8734a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff86a7eb-d4fa-4855-8d82-47299c1863d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Volume cf3ff1e2-1cee-4745-8a11-26481efe5dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9', 'volume_size': 1} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-399182677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ff1e2-1cee-4745-8a11-26481efe5dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe748c1ee5e428b957bdaeaafd8e07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:14Z,use_quota=True,user_id='3cb1b936433a4cfd9206da0f85fa5ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Creating volume cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:13 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:13 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 1073741824 Sep 28 16:19:13 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:13 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleted volume successfully. Sep 28 16:19:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-39ff101b-3acc-45de-a34d-bf1c7f579cf6 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-f10f7951-5213-4125-9288-ca3bc4187a34-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:14 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 1073741824" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:14 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 Sep 28 16:19:14 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:14 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" returned: 0 in 0.390s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (eec80df1-96ec-4aeb-ba79-6df366e811a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916f2aad-9b33-4b58-819f-427cfc3e8d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-565f93d7-febf-4110-ad9c-4830420766d2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3e3b78b4-a036-4605-95a4-1b1e93e5bcb0 tempest-ProjectAdminTests-2042603388 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1803398132324, 'free_capacity_gb': 1775.1803398132324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86628) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff86a7eb-d4fa-4855-8d82-47299c1863d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:14 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843bb263-6435-4074-9de8-fad6672e1f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916f2aad-9b33-4b58-819f-427cfc3e8d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175685783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a87a22-4472-4089-96c2-d603646ac96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:15Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbba6cba-5542-48f2-915a-d018cabc8e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbba6cba-5542-48f2-915a-d018cabc8e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dd98bb-49eb-49c2-9f62-99879298c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dd98bb-49eb-49c2-9f62-99879298c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a87a22-4472-4089-96c2-d603646ac96e', 'volume_name': 'volume-19a87a22-4472-4089-96c2-d603646ac96e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639b78c1-708c-492b-a8e2-0b4d6e5237e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639b78c1-708c-492b-a8e2-0b4d6e5237e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8566cbdf-1855-4e57-9ff0-bb8f03380e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume 19a87a22-4472-4089-96c2-d603646ac96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a87a22-4472-4089-96c2-d603646ac96e', 'volume_size': 1} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1175685783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a87a22-4472-4089-96c2-d603646ac96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:15Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Creating volume 19a87a22-4472-4089-96c2-d603646ac96e {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:15 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-565f93d7-febf-4110-ad9c-4830420766d2-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:15 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Volume volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 (cf3ff1e2-1cee-4745-8a11-26481efe5dc9): created successfully Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843bb263-6435-4074-9de8-fad6672e1f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Flow 'volume_create_manager' (84f211eb-186b-48aa-82cb-6757e672b81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:15 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e 1073741824 Sep 28 16:19:15 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-246cd284-290e-40ec-8452-9db17b82678e tempest-CinderUnicodeTest-1633096864 None] Created volume successfully. Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-565f93d7-febf-4110-ad9c-4830420766d2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-565f93d7-febf-4110-ad9c-4830420766d2" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47bcad4-1781-4bec-af7b-5ff61e7d902e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (bb9297d6-e4ae-409b-98a3-078423fa795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ad5bff-a6ed-4290-bfa0-67e4d1f6890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ad5bff-a6ed-4290-bfa0-67e4d1f6890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-769414252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ce8386-1dac-4940-a282-5d3b2c15946f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:15Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 Sep 28 16:19:15 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ad4fbf-916b-4424-8ba1-03c2a237b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ad4fbf-916b-4424-8ba1-03c2a237b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f62485-2cb5-4845-8353-ef5802df8b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f62485-2cb5-4845-8353-ef5802df8b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ce8386-1dac-4940-a282-5d3b2c15946f', 'volume_name': 'volume-c1ce8386-1dac-4940-a282-5d3b2c15946f', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b14d3c-d1cf-4390-8415-0473c8feca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b14d3c-d1cf-4390-8415-0473c8feca1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eee434e-9955-43cb-8327-3a6dbdd87cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume c1ce8386-1dac-4940-a282-5d3b2c15946f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ce8386-1dac-4940-a282-5d3b2c15946f', 'volume_size': 1} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:15 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e 1073741824" returned: 0 in 0.777s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:16 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e Sep 28 16:19:16 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:16 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2" returned: 0 in 0.862s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:16 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2 Sep 28 16:19:16 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (c24964e1-6358-4d81-ab53-2f9caa5cda51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb6d31e-f7b1-4157-9bff-2d00351828bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb6d31e-f7b1-4157-9bff-2d00351828bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076526462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90509a5a-ac75-49ea-8a52-7c5ddf016773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:16Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6a647e-4808-4f3c-b685-522b95fd8e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6a647e-4808-4f3c-b685-522b95fd8e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32de18e-cbe7-470b-be39-754805138129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32de18e-cbe7-470b-be39-754805138129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90509a5a-ac75-49ea-8a52-7c5ddf016773', 'volume_name': 'volume-90509a5a-ac75-49ea-8a52-7c5ddf016773', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741a3636-e0b4-4015-8aed-01d85b82b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741a3636-e0b4-4015-8aed-01d85b82b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a5e94d-951e-4ddd-a71b-427f543b166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume 90509a5a-ac75-49ea-8a52-7c5ddf016773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90509a5a-ac75-49ea-8a52-7c5ddf016773', 'volume_size': 1} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e" returned: 0 in 0.665s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-565f93d7-febf-4110-ad9c-4830420766d2" returned: 0 in 0.492s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-769414252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ce8386-1dac-4940-a282-5d3b2c15946f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:15Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Creating volume c1ce8386-1dac-4940-a282-5d3b2c15946f {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:16 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8566cbdf-1855-4e57-9ff0-bb8f03380e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a87a22-4472-4089-96c2-d603646ac96e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9da6c12-29bb-453b-bf1e-6f9033b1a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-565f93d7-febf-4110-ad9c-4830420766d2" released by "delete_volume" :: held 1.498s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:16 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f 1073741824 Sep 28 16:19:16 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume volume-19a87a22-4472-4089-96c2-d603646ac96e (19a87a22-4472-4089-96c2-d603646ac96e): created successfully Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9da6c12-29bb-453b-bf1e-6f9033b1a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (eec80df1-96ec-4aeb-ba79-6df366e811a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-dbaa698d-39cb-4a7f-8df0-f872489a17fb tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created volume successfully. Sep 28 16:19:16 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['c63f3748-b18f-470e-9719-36a2505c1c52', '1ad2f578-9be8-461a-9962-96c3f1f6d648', '3193f863-624d-48ca-b2fc-1ec18f07ece5', '6f559001-601d-4116-a16e-a8c738a6467d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (ce14ad7c-f06b-4d88-a84e-e33b04384470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e49071-7522-4d95-a3a2-a9c0f18579ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e49071-7522-4d95-a3a2-a9c0f18579ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095613283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1103d31b-1622-4d62-a026-f07447f0772e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:17Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1293055-2015-45ab-80ac-2e82d2812a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1293055-2015-45ab-80ac-2e82d2812a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:17 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fa53c0-a352-4e73-a40d-020ccf869937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fa53c0-a352-4e73-a40d-020ccf869937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1103d31b-1622-4d62-a026-f07447f0772e', 'volume_name': 'volume-1103d31b-1622-4d62-a026-f07447f0772e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842bd169-8f09-453f-991e-2b7809750197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842bd169-8f09-453f-991e-2b7809750197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abac93d6-c61a-4258-8110-460c3aff484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume 1103d31b-1622-4d62-a026-f07447f0772e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1103d31b-1622-4d62-a026-f07447f0772e', 'volume_size': 1} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:17 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f 1073741824" returned: 0 in 0.783s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:17 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.421s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (eab3e289-0046-49cb-ad6c-763a91387ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eecf7e-7f5b-4c51-af26-f45be0855b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleted volume successfully. Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eecf7e-7f5b-4c51-af26-f45be0855b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157303530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a74f7f-1875-4c3f-801e-918ba12c9d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:17Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8590c13f-b1e8-4fbc-8fa9-b8783c9cf20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8590c13f-b1e8-4fbc-8fa9-b8783c9cf20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f7b0f5-8467-4214-b14d-9af542b90daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f7b0f5-8467-4214-b14d-9af542b90daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a74f7f-1875-4c3f-801e-918ba12c9d62', 'volume_name': 'volume-08a74f7f-1875-4c3f-801e-918ba12c9d62', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac559e0c-9a90-45e1-b045-36164e9e3c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac559e0c-9a90-45e1-b045-36164e9e3c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3da7da-a67e-4baf-94c3-f85b6ca66860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:17 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume 08a74f7f-1875-4c3f-801e-918ba12c9d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a74f7f-1875-4c3f-801e-918ba12c9d62', 'volume_size': 1} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-ef81bd6a-516b-441d-8c92-08676685d681-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ecd68f49-8053-426d-a96c-22d5e7400a79 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-565f93d7-febf-4110-ad9c-4830420766d2-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-ef81bd6a-516b-441d-8c92-08676685d681-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:17 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f Sep 28 16:19:17 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-ef81bd6a-516b-441d-8c92-08676685d681" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-ef81bd6a-516b-441d-8c92-08676685d681" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[167a0268-2fe3-43d3-a38a-ce41392ea3b9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:17 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 Sep 28 16:19:17 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f" returned: 0 in 0.389s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076526462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90509a5a-ac75-49ea-8a52-7c5ddf016773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:16Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Creating volume 90509a5a-ac75-49ea-8a52-7c5ddf016773 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:18 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eee434e-9955-43cb-8327-3a6dbdd87cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ce8386-1dac-4940-a282-5d3b2c15946f', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:18 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 1073741824 Sep 28 16:19:18 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f58750-54b5-415c-9b14-e172b66de35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:18 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume volume-c1ce8386-1dac-4940-a282-5d3b2c15946f (c1ce8386-1dac-4940-a282-5d3b2c15946f): created successfully Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f58750-54b5-415c-9b14-e172b66de35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (bb9297d6-e4ae-409b-98a3-078423fa795b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f5ba4330-982d-4d8d-abbb-331efbe21609 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created volume successfully. Sep 28 16:19:18 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681" returned: 0 in 0.557s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681 Sep 28 16:19:18 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 1073741824" returned: 0 in 0.674s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-ef81bd6a-516b-441d-8c92-08676685d681" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-ef81bd6a-516b-441d-8c92-08676685d681" released by "delete_volume" :: held 1.079s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:18 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 Sep 28 16:19:18 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['7e52baa6-54f4-446b-8f52-adf2e5bfb575', 'f6519649-a8da-4853-b9e7-22a8bf5ace80', 'd2dab56d-5b19-49bf-a00b-a00bbe3a1856', '2c8d4800-6ec9-4f3f-8853-528b79fc7636'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:19 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.351s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a5e94d-951e-4ddd-a71b-427f543b166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90509a5a-ac75-49ea-8a52-7c5ddf016773', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9e83fc-8d00-473d-8a5c-3ad91c83bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Creating offline snapshot 8f3b237e-75b5-48eb-8d1d-cff82d292575 of volume cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:19:19 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 (90509a5a-ac75-49ea-8a52-7c5ddf016773): created successfully Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9e83fc-8d00-473d-8a5c-3ad91c83bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (c24964e1-6358-4d81-ab53-2f9caa5cda51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26eab1-9e91-415b-a7c0-6019f34715eb]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6dea1ee6-655d-4b03-8324-d4e46917e0e4 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created volume successfully. Sep 28 16:19:19 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 Sep 28 16:19:19 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.361s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:19 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleted volume successfully. Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-48a6c1f1-f3cf-437a-bbf7-3c506623ac41 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-ef81bd6a-516b-441d-8c92-08676685d681-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:19 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" returned: 0 in 0.496s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 1G Sep 28 16:19:19 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-6985007a-39e5-49b5-9254-866f18d8d976-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-6985007a-39e5-49b5-9254-866f18d8d976-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-6985007a-39e5-49b5-9254-866f18d8d976" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-6985007a-39e5-49b5-9254-866f18d8d976" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleting offline snapshot 6985007a-39e5-49b5-9254-866f18d8d976 of volume 0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] snapshot_file for this snap is: volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928ea99-4b90-47c0-a3e4-1f61367acce2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 Sep 28 16:19:20 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 1G" returned: 0 in 0.577s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 Sep 28 16:19:20 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976" returned: 0 in 0.447s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea3e39-9278-4c04-85b8-9b1d1a21fdad]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575" returned: 0 in 0.361s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 is being set with open permissions: ugo+rw Sep 28 16:19:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 Sep 28 16:19:20 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 Sep 28 16:19:20 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" returned: 0 in 0.512s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info Sep 28 16:19:21 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 Sep 28 16:19:21 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Flow 'volume_create_manager' (9b1c93ef-57ab-4d48-bb97-a91c7a40fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a5bc6f-af57-4e19-91d0-8d41ae4c8590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:21 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info" returned: 0 in 0.298s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a5bc6f-af57-4e19-91d0-8d41ae4c8590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455055722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755c988c-7547-4308-9506-8465091bb44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a532c19703459e9ed071e99361a355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:21Z,use_quota=True,user_id='9792a3ca8a2948cabddfeff0b8e9c1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645ba743-3162-4f9c-9924-3ad3ef8cbfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645ba743-3162-4f9c-9924-3ad3ef8cbfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7713d668-8bec-46ed-9e85-378adfcd3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7713d668-8bec-46ed-9e85-378adfcd3de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755c988c-7547-4308-9506-8465091bb44b', 'volume_name': 'volume-755c988c-7547-4308-9506-8465091bb44b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b394f16-46b3-4eb6-99b7-50557c0755c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b394f16-46b3-4eb6-99b7-50557c0755c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa73988e-0d61-4c1a-a252-a1944114d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:21 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Volume 755c988c-7547-4308-9506-8465091bb44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755c988c-7547-4308-9506-8465091bb44b', 'volume_size': 1} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:21 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info is being set with open permissions: ugo+rw Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info Sep 28 16:19:21 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976" returned: 0 in 0.398s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976 Sep 28 16:19:21 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.info" returned: 0 in 0.267s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095613283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1103d31b-1622-4d62-a026-f07447f0772e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:17Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Creating volume 1103d31b-1622-4d62-a026-f07447f0772e {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:21 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e 1073741824 Sep 28 16:19:21 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4a02f8c3-76b8-43ed-ac53-39a32d5eab54 tempest-CinderUnicodeTest-1633096864 None] Create snapshot completed successfully Sep 28 16:19:21 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38.6985007a-39e5-49b5-9254-866f18d8d976" returned: 0 in 0.343s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-6985007a-39e5-49b5-9254-866f18d8d976" released by "_delete_snapshot" :: held 1.861s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" released by "delete_snapshot" :: held 1.889s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:21 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['194298c1-28ec-4b08-904a-cde687acf1dc', 'a8a987a8-5592-42bb-8628-eb1b030cb64b', 'c96f3243-b841-421a-9da5-7fd8be5eff6c', 'd689c0b0-1383-4367-93af-8e0f7c8ec510'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Delete snapshot completed successfully. Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3269afc4-8c6a-43e0-8b34-aa9117c8c8c8 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-6985007a-39e5-49b5-9254-866f18d8d976-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "cinder-quobyte-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[37710646-a291-476f-a6c9-4cc726967543]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e 1073741824" returned: 0 in 0.621s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e Sep 28 16:19:22 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 Sep 28 16:19:22 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.159s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157303530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a74f7f-1875-4c3f-801e-918ba12c9d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4692f5ef504e439e1bff5b32fb2569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:17Z,use_quota=True,user_id='42e56b7eec69454b856caa8f433f13bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Creating volume 08a74f7f-1875-4c3f-801e-918ba12c9d62 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:22 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 1073741824 Sep 28 16:19:22 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abac93d6-c61a-4258-8110-460c3aff484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1103d31b-1622-4d62-a026-f07447f0772e', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3096334f-6a92-422a-87ec-24cc44b255aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:22 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume volume-1103d31b-1622-4d62-a026-f07447f0772e (1103d31b-1622-4d62-a026-f07447f0772e): created successfully Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3096334f-6a92-422a-87ec-24cc44b255aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (ce14ad7c-f06b-4d88-a84e-e33b04384470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:22 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-8f3b237e-75b5-48eb-8d1d-cff82d292575-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-6585dcca-e66f-45a6-b19f-0bc3470ba1fe tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created volume successfully. Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" returned: 0 in 0.575s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38 Sep 28 16:19:22 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-8f3b237e-75b5-48eb-8d1d-cff82d292575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-quobyte-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-quobyte-8f3b237e-75b5-48eb-8d1d-cff82d292575" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-8f3b237e-75b5-48eb-8d1d-cff82d292575" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Deleting offline snapshot 8f3b237e-75b5-48eb-8d1d-cff82d292575 of volume cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] snapshot_file for this snap is: volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b154f-f41d-47de-8071-222b41aec102]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 Sep 28 16:19:23 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" returned: 0 in 0.359s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-quobyte-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38" released by "delete_volume" :: held 1.028s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Created reservations ['9b930d51-fbcd-4564-bc07-712111781ea2', '8e61784f-3296-4300-bcb5-9bdeda89dc77', '0a191830-abb5-4230-998d-9d4c38b74d53', '957c997b-d28c-48ce-a7b7-dfeba76da94d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:23 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 1073741824" returned: 0 in 0.689s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:23 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 Sep 28 16:19:23 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575" returned: 0 in 0.581s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f3609-a063-4f49-9ad4-8a24475e574d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 Sep 28 16:19:23 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.317s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Deleted volume successfully. Sep 28 16:19:23 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62" returned: 0 in 0.320s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455055722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755c988c-7547-4308-9506-8465091bb44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a532c19703459e9ed071e99361a355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:21Z,use_quota=True,user_id='9792a3ca8a2948cabddfeff0b8e9c1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Creating volume 755c988c-7547-4308-9506-8465091bb44b {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:23 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2aabafbf-d144-463f-91cc-e2383d3bf370 tempest-CreateVolumesFromSnapshotTest-1503976792 None] Lock "cinder-0a6f10e8-5e3e-4bc3-9a01-abe0052f7a38-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:23 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b 1073741824 Sep 28 16:19:23 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3da7da-a67e-4baf-94c3-f85b6ca66860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a74f7f-1875-4c3f-801e-918ba12c9d62', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e75e4c4-a7a8-4f92-8dca-1b1333eb71cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:23 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Volume volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 (08a74f7f-1875-4c3f-801e-918ba12c9d62): created successfully Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e75e4c4-a7a8-4f92-8dca-1b1333eb71cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:23 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Flow 'volume_create_manager' (eab3e289-0046-49cb-ad6c-763a91387ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-93082576-c25d-4209-adf4-cde26091f7f3 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created volume successfully. Sep 28 16:19:24 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" returned: 0 in 0.445s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 Sep 28 16:19:24 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-08a74f7f-1875-4c3f-801e-918ba12c9d62-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-08a74f7f-1875-4c3f-801e-918ba12c9d62-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-quobyte-08a74f7f-1875-4c3f-801e-918ba12c9d62" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-08a74f7f-1875-4c3f-801e-918ba12c9d62" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449e09a-aaa8-47f9-9009-23fb58a56eeb]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b 1073741824" returned: 0 in 0.649s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 Sep 28 16:19:24 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b Sep 28 16:19:24 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575" returned: 0 in 0.503s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575 Sep 28 16:19:24 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62" returned: 0 in 0.430s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62 Sep 28 16:19:24 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9.8f3b237e-75b5-48eb-8d1d-cff82d292575" returned: 0 in 0.327s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-8f3b237e-75b5-48eb-8d1d-cff82d292575" released by "_delete_snapshot" :: held 2.027s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa73988e-0d61-4c1a-a252-a1944114d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755c988c-7547-4308-9506-8465091bb44b', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64adf6e6-500b-4c57-ac9d-6477125928d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" released by "delete_snapshot" :: held 2.071s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:25 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Volume volume-755c988c-7547-4308-9506-8465091bb44b (755c988c-7547-4308-9506-8465091bb44b): created successfully Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64adf6e6-500b-4c57-ac9d-6477125928d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Flow 'volume_create_manager' (9b1c93ef-57ab-4d48-bb97-a91c7a40fc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d4be2dc1-542c-4411-ac39-5a066392d3d9 tempest-ProjectReaderTests-1619511992 None] Created volume successfully. Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Created reservations ['9e9ecbcb-d2d7-47d0-9814-94b8b8d6f9fa', '50d71a0f-6f53-4393-8219-40e7fd162dd7', '53ef66d5-66ee-4f4a-bc93-eca59dfac226', '5eb7887b-9f09-4a03-a4a5-6b2278157903'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Delete snapshot completed successfully. Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8586d54d-3e25-4ef4-b729-84bc6da24c5e tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-8f3b237e-75b5-48eb-8d1d-cff82d292575-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:25 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-08a74f7f-1875-4c3f-801e-918ba12c9d62" returned: 0 in 0.338s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-08a74f7f-1875-4c3f-801e-918ba12c9d62" released by "delete_volume" :: held 0.828s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created reservations ['a1b1e91b-8e25-4ace-a59f-58aa3d3fdb3d', 'cbf523a9-f26f-4880-ae5a-0ca056e5f6eb', '16b05ddd-39a2-4d32-9fa3-7dfc309ce565', '6a4470dd-a883-4be4-be89-e39963c877eb'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:25 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:25 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-1103d31b-1622-4d62-a026-f07447f0772e-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-1103d31b-1622-4d62-a026-f07447f0772e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-quobyte-1103d31b-1622-4d62-a026-f07447f0772e" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-1103d31b-1622-4d62-a026-f07447f0772e" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:25 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.398s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5c81c-269c-4eb5-b05c-5033252e9b6e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Deleted volume successfully. Sep 28 16:19:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-697b5564-b588-4c29-83c3-f83f371f4a9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-08a74f7f-1875-4c3f-801e-918ba12c9d62-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:26 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e Sep 28 16:19:26 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "cinder-755c988c-7547-4308-9506-8465091bb44b-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-755c988c-7547-4308-9506-8465091bb44b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "cinder-quobyte-755c988c-7547-4308-9506-8465091bb44b" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-quobyte-755c988c-7547-4308-9506-8465091bb44b" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02cf0a1-e742-4928-83b9-6f4dd1ad003e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-cf3ff1e2-1cee-4745-8a11-26481efe5dc9-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-cf3ff1e2-1cee-4745-8a11-26481efe5dc9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-quobyte-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" acquired by "delete_volume" :: waited 0.043s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:26 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b Sep 28 16:19:26 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5e6a9-6be9-46aa-bb3d-88b636a93f69]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:26 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e" returned: 0 in 0.636s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:26 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e Sep 28 16:19:26 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:26 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 Sep 28 16:19:26 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:26 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:26 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:26 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:26 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b" returned: 0 in 0.625s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1103d31b-1622-4d62-a026-f07447f0772e" returned: 0 in 0.378s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:26 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b Sep 28 16:19:26 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-1103d31b-1622-4d62-a026-f07447f0772e" released by "delete_volume" :: held 1.109s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created reservations ['eaf9e261-d186-4b1c-859f-014b18bba32a', 'b4e2abfd-3e29-4fba-b344-634ee32b8630', '650e201a-6927-4f1e-a38d-e8319ede5c7b', '95e76dc6-18d6-4e77-8c97-d0cde6d564ab'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:27 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" returned: 0 in 0.735s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:27 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9 Sep 28 16:19:27 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-755c988c-7547-4308-9506-8465091bb44b" returned: 0 in 0.439s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:27 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-quobyte-755c988c-7547-4308-9506-8465091bb44b" released by "delete_volume" :: held 1.165s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:27 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.580s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Created reservations ['139fd2e6-3086-4ad4-a17a-3a5fd7d9aa2f', '8e2f1911-76f3-4a27-80dd-12643f1377e8', 'a975e58e-ff9b-4123-852b-ee5f4b278f65', '4e0b649a-cdf4-4397-a338-c506ea7385de'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:27 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" returned: 0 in 0.419s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.376s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:27 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-cf3ff1e2-1cee-4745-8a11-26481efe5dc9" released by "delete_volume" :: held 1.258s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:27 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Deleted volume successfully. Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-9f06fecc-27d5-47af-8b5a-39bd03604a27 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-1103d31b-1622-4d62-a026-f07447f0772e-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Created reservations ['14000ebe-d5b8-435c-bb6d-5c3c6494d459', '7af99685-8030-4f93-948f-3f9ea14db9e9', 'a449a7c9-9665-4102-9167-e4d363cab435', 'ba92d290-85f7-429d-af25-34f99de5623b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:27 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:27 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.336s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:27 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Deleted volume successfully. Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-919662e4-3f48-42db-a02e-f605cee90f72 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-755c988c-7547-4308-9506-8465091bb44b-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-90509a5a-ac75-49ea-8a52-7c5ddf016773-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-90509a5a-ac75-49ea-8a52-7c5ddf016773-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-quobyte-90509a5a-ac75-49ea-8a52-7c5ddf016773" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-90509a5a-ac75-49ea-8a52-7c5ddf016773" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:28 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.322s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Deleted volume successfully. Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae609297-0ad6-431b-a4f1-70a09d55aa1f]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-178a612b-f4b8-42d6-94ad-ed7409f1eae3 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-cf3ff1e2-1cee-4745-8a11-26481efe5dc9-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:28 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 Sep 28 16:19:28 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:28 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773" returned: 0 in 0.555s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:28 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773 Sep 28 16:19:28 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-49dbd223-1fcc-4a77-a2a8-536334e0cff3-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-49dbd223-1fcc-4a77-a2a8-536334e0cff3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:29 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-90509a5a-ac75-49ea-8a52-7c5ddf016773" returned: 0 in 0.410s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "cinder-quobyte-49dbd223-1fcc-4a77-a2a8-536334e0cff3" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-90509a5a-ac75-49ea-8a52-7c5ddf016773" released by "delete_volume" :: held 1.042s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-49dbd223-1fcc-4a77-a2a8-536334e0cff3" acquired by "delete_volume" :: waited 0.049s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[313057ae-9bd6-4ff8-8d2a-6f7efaf3b13e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created reservations ['a219af75-8d6c-4eda-a138-056181943486', '557a73b7-912e-4eea-9b26-c0c0898a3f89', 'cdca3d4b-88b8-44c5-87a4-ef8c58eaf401', '5207c39d-5f86-4efe-afe8-3242ee68dde3'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Flow 'volume_create_manager' (47ab0370-2622-4736-8308-b2a24df17138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17852b8c-f50a-467e-8bac-74cf6842d7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 Sep 28 16:19:29 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17852b8c-f50a-467e-8bac-74cf6842d7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1983180488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c993a59-90b0-4990-bc9d-603776f4ee24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a645872136c4148aaf64b5ca2985ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:29Z,use_quota=True,user_id='5ef82a60b74041b6a44667de252850c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87230c6d-615a-4fb7-bea3-f9728852edfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87230c6d-615a-4fb7-bea3-f9728852edfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe6a68e-b9bb-4a88-a4ab-512a91287aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe6a68e-b9bb-4a88-a4ab-512a91287aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c993a59-90b0-4990-bc9d-603776f4ee24', 'volume_name': 'volume-2c993a59-90b0-4990-bc9d-603776f4ee24', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ed82e4-e6e6-4c59-bc42-db9ae9df1a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ed82e4-e6e6-4c59-bc42-db9ae9df1a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fd2487-bf89-482e-af90-f9804b0b07ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Volume 2c993a59-90b0-4990-bc9d-603776f4ee24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c993a59-90b0-4990-bc9d-603776f4ee24', 'volume_size': 1} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1983180488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c993a59-90b0-4990-bc9d-603776f4ee24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a645872136c4148aaf64b5ca2985ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:29Z,use_quota=True,user_id='5ef82a60b74041b6a44667de252850c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Creating volume 2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:29 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:29 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 1073741824 Sep 28 16:19:29 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Flow 'volume_create_manager' (45ae3526-bb31-4feb-87d8-3205933bf493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dce25d0-91b8-4aef-88f7-bebb6c3daa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dce25d0-91b8-4aef-88f7-bebb6c3daa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582935022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a7553d-7f9e-45fc-b700-3bb52d2dab7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a532c19703459e9ed071e99361a355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:29Z,use_quota=True,user_id='9792a3ca8a2948cabddfeff0b8e9c1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069bb45a-1c72-4c57-91d6-edbd605cee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069bb45a-1c72-4c57-91d6-edbd605cee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee999153-6760-446c-90db-194c001cea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee999153-6760-446c-90db-194c001cea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a7553d-7f9e-45fc-b700-3bb52d2dab7c', 'volume_name': 'volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63141b05-2457-4137-aaa1-6e1def8508aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63141b05-2457-4137-aaa1-6e1def8508aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fa6547-1629-4f7a-92da-1fcea7159c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:29 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Volume b3a7553d-7f9e-45fc-b700-3bb52d2dab7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c', 'volume_size': 1} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:29 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:29 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:29 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3 Sep 28 16:19:29 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:30 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.367s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Deleted volume successfully. Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3c41cf39-9de9-480b-8776-0c9264795d90 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-90509a5a-ac75-49ea-8a52-7c5ddf016773-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:30 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 1073741824" returned: 0 in 0.602s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:30 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-49dbd223-1fcc-4a77-a2a8-536334e0cff3" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-quobyte-49dbd223-1fcc-4a77-a2a8-536334e0cff3" released by "delete_volume" :: held 0.951s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:30 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 Sep 28 16:19:30 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Created reservations ['ddeb6ef6-c153-419d-8001-2f6740496d05', 'c77f51e6-022b-416f-9b3c-9619ef770fd1', 'f3ad567c-fa83-4d7d-9a84-96b59d9100e4', '73e48c5d-8caf-43e1-875c-f9e421338255'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-c1ce8386-1dac-4940-a282-5d3b2c15946f-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:30 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:30 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-c1ce8386-1dac-4940-a282-5d3b2c15946f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-quobyte-c1ce8386-1dac-4940-a282-5d3b2c15946f" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-c1ce8386-1dac-4940-a282-5d3b2c15946f" acquired by "delete_volume" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:30 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24" returned: 0 in 0.363s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582935022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a7553d-7f9e-45fc-b700-3bb52d2dab7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a532c19703459e9ed071e99361a355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:29Z,use_quota=True,user_id='9792a3ca8a2948cabddfeff0b8e9c1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Creating volume b3a7553d-7f9e-45fc-b700-3bb52d2dab7c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:30 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b7ef09-5039-4add-8d0b-8c7da4a1b537]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:30 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c 1073741824 Sep 28 16:19:30 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fd2487-bf89-482e-af90-f9804b0b07ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c993a59-90b0-4990-bc9d-603776f4ee24', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a3c655-90b0-4823-8182-411d79b6b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:30 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Volume volume-2c993a59-90b0-4990-bc9d-603776f4ee24 (2c993a59-90b0-4990-bc9d-603776f4ee24): created successfully Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a3c655-90b0-4823-8182-411d79b6b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Flow 'volume_create_manager' (47ab0370-2622-4736-8308-b2a24df17138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-38080ac3-a011-4d8a-abcf-90117050025b tempest-VolumeDependencyTests-1551055445 None] Created volume successfully. Sep 28 16:19:30 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.322s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Deleted volume successfully. Sep 28 16:19:30 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f Sep 28 16:19:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f0636044-7f7b-47bb-bfce-2804e79f96e0 tempest-CinderUnicodeTest-1633096864 None] Lock "cinder-49dbd223-1fcc-4a77-a2a8-536334e0cff3-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:30 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:31 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f" returned: 0 in 0.496s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:31 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c 1073741824" returned: 0 in 0.528s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:31 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f Sep 28 16:19:31 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:31 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c Sep 28 16:19:31 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:31 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c1ce8386-1dac-4940-a282-5d3b2c15946f" returned: 0 in 0.340s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-c1ce8386-1dac-4940-a282-5d3b2c15946f" released by "delete_volume" :: held 0.930s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:31 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c" returned: 0 in 0.442s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.032s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created reservations ['bbe6859d-7029-4ab9-949c-1abece836341', 'fcece3f9-243e-4e71-abe7-93c8dd868fe7', 'bdea6bc1-1237-4d8a-818c-88ebd3002c9c', '33ea4a88-b467-490f-bdcb-2a543ba400d1'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Creating offline snapshot af8e615c-0cde-4d2f-8388-40fb9b858950 of volume 2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fa6547-1629-4f7a-92da-1fcea7159c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2c1cc6-d11e-42ae-b66c-c047d40da58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a45d4-5883-40ca-abb9-a86b301cb8b5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:31 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Volume volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c (b3a7553d-7f9e-45fc-b700-3bb52d2dab7c): created successfully Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2c1cc6-d11e-42ae-b66c-c047d40da58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Flow 'volume_create_manager' (45ae3526-bb31-4feb-87d8-3205933bf493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3a1306e6-c61d-4d75-85fe-4e370816d271 tempest-ProjectReaderTests-1619511992 None] Created volume successfully. Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:31 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 Sep 28 16:19:31 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:31 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:31 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:32 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:32 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Deleted volume successfully. Sep 28 16:19:32 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 1G Sep 28 16:19:32 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5a9a3f95-871f-4397-9880-f1267e7916e8 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-c1ce8386-1dac-4940-a282-5d3b2c15946f-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "cinder-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "cinder-quobyte-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-quobyte-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c" acquired by "delete_volume" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:32 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 1G" returned: 0 in 0.600s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c993a59-90b0-4990-bc9d-603776f4ee24 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47caa3f-0cec-4af6-b21c-1ab3ecafae90]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:32 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c993a59-90b0-4990-bc9d-603776f4ee24 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 Sep 28 16:19:32 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-19a87a22-4472-4089-96c2-d603646ac96e-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-19a87a22-4472-4089-96c2-d603646ac96e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:32 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c Sep 28 16:19:32 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-quobyte-19a87a22-4472-4089-96c2-d603646ac96e" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-19a87a22-4472-4089-96c2-d603646ac96e" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf47549-52ed-4985-927c-d5b4688a02f1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:33 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e Sep 28 16:19:33 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:33 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c993a59-90b0-4990-bc9d-603776f4ee24 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950" returned: 0 in 0.455s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:33 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 is being set with open permissions: ugo+rw Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:33 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 Sep 28 16:19:33 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:33 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c" returned: 0 in 0.571s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:33 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c Sep 28 16:19:33 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:33 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e" returned: 0 in 0.564s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:33 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e Sep 28 16:19:33 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:33 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950" returned: 0 in 0.401s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:33 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c" returned: 0 in 0.368s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:33 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info Sep 28 16:19:33 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-quobyte-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c" released by "delete_volume" :: held 1.032s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Created reservations ['7e570833-e763-4dc7-a82e-d1d892e3776c', '16a7d3cc-7ac5-4e4a-b138-8fc1ac80cd79', '069ca1b6-0898-402d-a066-3117a882a326', 'a23d54fa-63ce-4e71-ac58-3ba42532c0ae'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:33 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-19a87a22-4472-4089-96c2-d603646ac96e" returned: 0 in 0.396s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:33 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:33 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-19a87a22-4472-4089-96c2-d603646ac96e" released by "delete_volume" :: held 1.025s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created reservations ['da601c24-ec27-41fe-8c3f-0e256c50c33d', 'a2330c65-9133-4b5d-9280-93454565a519', '55763b24-0057-4c8f-9d3f-b47eba9a230f', 'fb3e9eb0-269f-442e-89f8-cb3b0b28184f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:34 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:34 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info is being set with open permissions: ugo+rw Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:34 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info Sep 28 16:19:34 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:34 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:34 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:34 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.373s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Deleted volume successfully. Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4046b548-d43f-4b62-9208-f78d059135e5 tempest-ProjectReaderTests-1619511992 None] Lock "cinder-b3a7553d-7f9e-45fc-b700-3bb52d2dab7c-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:34 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.info" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c22ea398-9421-42fd-9611-06d981affc7a tempest-VolumeDependencyTests-1551055445 None] Create snapshot completed successfully Sep 28 16:19:34 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.359s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Deleted volume successfully. Sep 28 16:19:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f2fad7f9-71d1-449e-9982-0f761610d4f5 tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-19a87a22-4472-4089-96c2-d603646ac96e-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-4c6ef356-a38a-4afc-9265-87d12eb5637d-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-4c6ef356-a38a-4afc-9265-87d12eb5637d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "cinder-quobyte-4c6ef356-a38a-4afc-9265-87d12eb5637d" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-4c6ef356-a38a-4afc-9265-87d12eb5637d" acquired by "delete_volume" :: waited 0.037s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6e1179-21b7-48bd-a8d4-c538b5433faa]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:35 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d Sep 28 16:19:35 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Flow 'volume_create_manager' (a571c84c-b01c-45fb-aafb-4cee4056ae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede02ebd-b24c-4695-aac7-7ab0dbff13e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede02ebd-b24c-4695-aac7-7ab0dbff13e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1492336601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebfede5-3235-4df1-bb27-46811675c117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a645872136c4148aaf64b5ca2985ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af8e615c-0cde-4d2f-8388-40fb9b858950,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:35Z,use_quota=True,user_id='5ef82a60b74041b6a44667de252850c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6343a70f-1d18-4995-a271-dd07e6d68391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6343a70f-1d18-4995-a271-dd07e6d68391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fa7796-05d8-4122-9abf-47097f012b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fa7796-05d8-4122-9abf-47097f012b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ebfede5-3235-4df1-bb27-46811675c117', 'volume_name': 'volume-4ebfede5-3235-4df1-bb27-46811675c117', 'volume_size': 1, 'snapshot_id': 'af8e615c-0cde-4d2f-8388-40fb9b858950'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29246e7c-52c3-486f-9bf9-90afb8c54155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29246e7c-52c3-486f-9bf9-90afb8c54155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c831456a-2f7f-4fb5-9108-7d94b9efc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:35 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Volume 4ebfede5-3235-4df1-bb27-46811675c117: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ebfede5-3235-4df1-bb27-46811675c117', 'volume_size': 1, 'snapshot_id': 'af8e615c-0cde-4d2f-8388-40fb9b858950'} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-quobyte-af8e615c-0cde-4d2f-8388-40fb9b858950-4ebfede5-3235-4df1-bb27-46811675c117" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-af8e615c-0cde-4d2f-8388-40fb9b858950-4ebfede5-3235-4df1-bb27-46811675c117" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Creating volume 4ebfede5-3235-4df1-bb27-46811675c117 from snapshot af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-quobyte-4ebfede5-3235-4df1-bb27-46811675c117" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-4ebfede5-3235-4df1-bb27-46811675c117" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] snapshot: af8e615c-0cde-4d2f-8388-40fb9b858950, volume: 4ebfede5-3235-4df1-bb27-46811675c117, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[881fb6f7-4131-4fa9-b012-a9c774ef10d5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:35 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:35 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d" returned: 0 in 0.583s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:35 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:36 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d Sep 28 16:19:36 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:36 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950" returned: 0 in 0.526s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c993a59-90b0-4990-bc9d-603776f4ee24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[24deaacb-1ab5-48a4-a12b-7d8b0d0a25be]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:36 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4c6ef356-a38a-4afc-9265-87d12eb5637d" returned: 0 in 0.460s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-quobyte-4c6ef356-a38a-4afc-9265-87d12eb5637d" released by "delete_volume" :: held 1.122s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Created reservations ['9980cd6f-b429-4470-bd4d-56d5ee8b1767', 'b6bc67b2-e0d8-42c2-bbfc-ac704ee89cf7', '7e12f27a-7def-4ed7-9289-35afdb1dc904', '742bd4f5-8273-4e05-9a11-8120510fb12b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:36 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 Sep 28 16:19:36 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:36 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:36 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:37 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24" returned: 0 in 0.573s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:19:37 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.323s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:37 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Deleted volume successfully. Sep 28 16:19:37 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 Sep 28 16:19:37 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-ebc0cc64-f82b-4f9b-b48c-23c004ab2c9d tempest-CreateVolumesFromSourceVolumeTest-687586060 None] Lock "cinder-4c6ef356-a38a-4afc-9265-87d12eb5637d-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:43 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=274,cinder:SELECT=202,cinder:INSERT=76,cinder:DELETE=26 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:43 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=195,cinder:UPDATE=277,cinder:DELETE=24,cinder:INSERT=70 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:46 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117" returned: 0 in 9.052s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:19:46 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Converted 1024.00 MB image at 113.12 MB/s Sep 28 16:19:46 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 is being set with open permissions: ugo+rw Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:46 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 Sep 28 16:19:46 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:46 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-4ebfede5-3235-4df1-bb27-46811675c117" released by "_copy_volume_from_snapshot" :: held 10.724s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-af8e615c-0cde-4d2f-8388-40fb9b858950-4ebfede5-3235-4df1-bb27-46811675c117" released by "_create_volume_from_snapshot" :: held 10.831s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.867s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c831456a-2f7f-4fb5-9108-7d94b9efc154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebfede5-3235-4df1-bb27-46811675c117', 'volume_size': 1, 'snapshot_id': 'af8e615c-0cde-4d2f-8388-40fb9b858950'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1135bdf4-320f-45e2-aae4-8dc732173a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:46 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Volume volume-4ebfede5-3235-4df1-bb27-46811675c117 (4ebfede5-3235-4df1-bb27-46811675c117): created successfully Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1135bdf4-320f-45e2-aae4-8dc732173a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Flow 'volume_create_manager' (a571c84c-b01c-45fb-aafb-4cee4056ae2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:46 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3954c094-cccd-4f28-92aa-6744c6a5bf05 tempest-VolumeDependencyTests-1551055445 None] Created volume successfully. Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-af8e615c-0cde-4d2f-8388-40fb9b858950-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-af8e615c-0cde-4d2f-8388-40fb9b858950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-quobyte-2c993a59-90b0-4990-bc9d-603776f4ee24" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-2c993a59-90b0-4990-bc9d-603776f4ee24" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-quobyte-af8e615c-0cde-4d2f-8388-40fb9b858950" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-af8e615c-0cde-4d2f-8388-40fb9b858950" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Deleting offline snapshot af8e615c-0cde-4d2f-8388-40fb9b858950 of volume 2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] snapshot_file for this snap is: volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c60ae-c094-42d5-95c6-7a92dcea029e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:47 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 Sep 28 16:19:47 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:47 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950" returned: 0 in 0.525s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c993a59-90b0-4990-bc9d-603776f4ee24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[879008ec-598f-4a77-a008-4668cd9ccd4a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:47 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 Sep 28 16:19:47 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:48 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24" returned: 0 in 0.759s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:48 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 Sep 28 16:19:48 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:48 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (57c11208-5990-4c6b-bcc4-3a5ca8477797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:48 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905c8436-6825-4bd1-9a52-bd47dcc17189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:49 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905c8436-6825-4bd1-9a52-bd47dcc17189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217969465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf395486-9fb9-4890-8b30-125f6e5f546d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:49Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d108106d-7dbc-4542-b149-ca540c2d6215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d108106d-7dbc-4542-b149-ca540c2d6215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6762ca86-4a68-4310-818a-752ff36639d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6762ca86-4a68-4310-818a-752ff36639d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf395486-9fb9-4890-8b30-125f6e5f546d', 'volume_name': 'volume-cf395486-9fb9-4890-8b30-125f6e5f546d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f588c3-afe1-41e7-8f30-97178ee1a402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f588c3-afe1-41e7-8f30-97178ee1a402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111350a3-186d-4018-92f4-5a8bf8413a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:49 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Volume cf395486-9fb9-4890-8b30-125f6e5f546d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf395486-9fb9-4890-8b30-125f6e5f546d', 'volume_size': 1} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217969465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf395486-9fb9-4890-8b30-125f6e5f546d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:49Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Creating volume cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:49 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950" returned: 0 in 0.591s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:49 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d 1073741824 Sep 28 16:19:49 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:49 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950 Sep 28 16:19:49 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:49 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24.af8e615c-0cde-4d2f-8388-40fb9b858950" returned: 0 in 0.382s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-af8e615c-0cde-4d2f-8388-40fb9b858950" released by "_delete_snapshot" :: held 2.412s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-2c993a59-90b0-4990-bc9d-603776f4ee24" released by "delete_snapshot" :: held 2.443s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Created reservations ['e9a94941-c805-4781-8768-c6c7fc548f94', '214d4478-6fed-49f4-9626-53dde27b6698', '73fc41db-6f74-4c53-b18b-3ef30ada8f7d', 'b4c3616a-a473-4ae6-9651-57a451543cbb'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Delete snapshot completed successfully. Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-2136820c-0f9c-4460-9e6d-1e5494b719cd tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-af8e615c-0cde-4d2f-8388-40fb9b858950-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:49 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d 1073741824" returned: 0 in 0.850s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:50 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d Sep 28 16:19:50 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:50 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d" returned: 0 in 0.276s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111350a3-186d-4018-92f4-5a8bf8413a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf395486-9fb9-4890-8b30-125f6e5f546d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28befa72-c4ce-4c3f-88a5-3576933f22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:50 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Volume volume-cf395486-9fb9-4890-8b30-125f6e5f546d (cf395486-9fb9-4890-8b30-125f6e5f546d): created successfully Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28befa72-c4ce-4c3f-88a5-3576933f22e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (57c11208-5990-4c6b-bcc4-3a5ca8477797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:50 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-a91604b7-ae70-4acc-a1cd-10a92905adec tempest-ProjectReaderTests-2062210395 None] Created volume successfully. Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-2c993a59-90b0-4990-bc9d-603776f4ee24-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-2c993a59-90b0-4990-bc9d-603776f4ee24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-quobyte-2c993a59-90b0-4990-bc9d-603776f4ee24" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-2c993a59-90b0-4990-bc9d-603776f4ee24" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1aa6e5-07ef-4075-9f05-5f74aa336eb8]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:50 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 Sep 28 16:19:50 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:50 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24" returned: 0 in 0.441s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:50 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24 Sep 28 16:19:50 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:51 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-2c993a59-90b0-4990-bc9d-603776f4ee24" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Creating offline snapshot 8765d43b-8dd9-4097-8dbb-03e1e74f024e of volume cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-2c993a59-90b0-4990-bc9d-603776f4ee24" released by "delete_volume" :: held 0.872s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6071b7ee-ae90-4a5d-bbe2-3bd5095e9684]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Created reservations ['84deb902-cc34-463d-87fa-185ab7daae4c', '43a504b4-c3e1-4cfa-908f-0f05eb22c0e9', 'fdd4b891-137d-44b1-8074-3776087a3941', 'bfe0c50d-023e-4a18-8681-8cc19993cdd2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:51 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d Sep 28 16:19:51 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:51 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:51 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-4ebfede5-3235-4df1-bb27-46811675c117-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-4ebfede5-3235-4df1-bb27-46811675c117-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "cinder-quobyte-4ebfede5-3235-4df1-bb27-46811675c117" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-4ebfede5-3235-4df1-bb27-46811675c117" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ba942-ecdd-4dc9-9f28-5d9df9594d2d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:51 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d" returned: 0 in 0.520s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:51 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e 1G Sep 28 16:19:51 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:51 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.453s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:51 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:51 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Deleted volume successfully. Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-11e9ef26-154f-4671-8247-ceb89f121161 tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-2c993a59-90b0-4990-bc9d-603776f4ee24-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:52 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 Sep 28 16:19:52 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117" returned: 0 in 0.617s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:52 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117 Sep 28 16:19:52 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e 1G" returned: 0 in 0.628s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf395486-9fb9-4890-8b30-125f6e5f546d -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:52 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf395486-9fb9-4890-8b30-125f6e5f546d -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e Sep 28 16:19:52 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4ebfede5-3235-4df1-bb27-46811675c117" returned: 0 in 0.296s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-quobyte-4ebfede5-3235-4df1-bb27-46811675c117" released by "delete_volume" :: held 0.992s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Created reservations ['ae8cf7e4-a00a-4497-9b21-7406ae0ac896', '4963365a-d575-42a3-acc7-f544f171c15c', 'b5486236-5a42-4bba-9046-c2879d06e5b1', '866ecb0d-b410-4058-a4da-620797a8d49e'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:52 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf395486-9fb9-4890-8b30-125f6e5f546d -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e" returned: 0 in 0.461s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e is being set with open permissions: ugo+rw Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:52 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:52 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:53 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:53 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:53 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.265s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:53 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Deleted volume successfully. Sep 28 16:19:53 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aecf16a1-0840-4405-aebc-64aa9394924d tempest-VolumeDependencyTests-1551055445 None] Lock "cinder-4ebfede5-3235-4df1-bb27-46811675c117-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:53 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info Sep 28 16:19:53 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:53 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:53 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info is being set with open permissions: ugo+rw Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:53 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info Sep 28 16:19:53 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:53 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.info" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:54 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-98ed7f8d-b8e3-429b-9eb4-90ff66fb6b17 tempest-ProjectReaderTests-2062210395 None] Create snapshot completed successfully Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-8765d43b-8dd9-4097-8dbb-03e1e74f024e-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-8765d43b-8dd9-4097-8dbb-03e1e74f024e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-cf395486-9fb9-4890-8b30-125f6e5f546d" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cf395486-9fb9-4890-8b30-125f6e5f546d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-8765d43b-8dd9-4097-8dbb-03e1e74f024e" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-8765d43b-8dd9-4097-8dbb-03e1e74f024e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Deleting offline snapshot 8765d43b-8dd9-4097-8dbb-03e1e74f024e of volume cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] snapshot_file for this snap is: volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce586d1e-1451-4933-9948-6ac769f93c24]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:55 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e Sep 28 16:19:55 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:55 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e" returned: 0 in 0.533s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:55 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf395486-9fb9-4890-8b30-125f6e5f546d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:55 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ece4b-41ae-4f2b-9d50-a8839fca5110]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:55 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d Sep 28 16:19:55 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:56 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d" returned: 0 in 0.567s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:56 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e Sep 28 16:19:56 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:56 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e" returned: 0 in 0.451s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:56 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e Sep 28 16:19:56 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:56 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d.8765d43b-8dd9-4097-8dbb-03e1e74f024e" returned: 0 in 0.316s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-8765d43b-8dd9-4097-8dbb-03e1e74f024e" released by "_delete_snapshot" :: held 2.025s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:56 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cf395486-9fb9-4890-8b30-125f6e5f546d" released by "delete_snapshot" :: held 2.063s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Created reservations ['535691ec-28c0-4810-9bbe-23818e417d22', '78e43c24-fdad-48a3-81c0-d20f030d8eb4', '0c76bf7e-4ec1-4aa4-a5db-0c6aece01d9d', 'fc7cbccd-dd97-4047-b110-1c3ff56dce7b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Delete snapshot completed successfully. Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-170862fa-3801-49c6-9d72-9828c3f883c5 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-8765d43b-8dd9-4097-8dbb-03e1e74f024e-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (d79d4b66-c516-430f-bcfd-682d47800d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd8ebf3-2a0e-4d32-bb2c-97beaaf0e748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd8ebf3-2a0e-4d32-bb2c-97beaaf0e748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046573648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678e8510-64cf-442a-8646-c5717f107b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:58Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9566bbca-67ed-4b37-9250-56caabff2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9566bbca-67ed-4b37-9250-56caabff2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca3b897-53f8-4164-835b-2448bafbeb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca3b897-53f8-4164-835b-2448bafbeb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678e8510-64cf-442a-8646-c5717f107b12', 'volume_name': 'volume-678e8510-64cf-442a-8646-c5717f107b12', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96495223-a121-4cff-bb89-b23952df8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96495223-a121-4cff-bb89-b23952df8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd385ad-90a5-4f73-90fa-7f32e79135c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:58 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Volume 678e8510-64cf-442a-8646-c5717f107b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678e8510-64cf-442a-8646-c5717f107b12', 'volume_size': 1} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046573648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678e8510-64cf-442a-8646-c5717f107b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:58Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Creating volume 678e8510-64cf-442a-8646-c5717f107b12 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:58 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:58 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 1073741824 Sep 28 16:19:58 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-cf395486-9fb9-4890-8b30-125f6e5f546d-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-cf395486-9fb9-4890-8b30-125f6e5f546d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-cf395486-9fb9-4890-8b30-125f6e5f546d" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cf395486-9fb9-4890-8b30-125f6e5f546d" acquired by "delete_volume" :: waited 0.015s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db316c-e58c-4852-b04e-c08bb4ddc14c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:58 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d Sep 28 16:19:58 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:58 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 1073741824" returned: 0 in 0.559s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:58 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 Sep 28 16:19:58 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:58 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d" returned: 0 in 0.446s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:58 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d Sep 28 16:19:58 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:58 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12" returned: 0 in 0.310s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd385ad-90a5-4f73-90fa-7f32e79135c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678e8510-64cf-442a-8646-c5717f107b12', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:58 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4452fa97-383c-4596-8682-c1751c12cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:59 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Volume volume-678e8510-64cf-442a-8646-c5717f107b12 (678e8510-64cf-442a-8646-c5717f107b12): created successfully Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4452fa97-383c-4596-8682-c1751c12cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (d79d4b66-c516-430f-bcfd-682d47800d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-27d37137-6062-40c7-bdb4-e697dcf731b3 tempest-ProjectReaderTests-1304994701 None] Created volume successfully. Sep 28 16:19:59 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cf395486-9fb9-4890-8b30-125f6e5f546d" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cf395486-9fb9-4890-8b30-125f6e5f546d" released by "delete_volume" :: held 0.856s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Created reservations ['2770cb60-da63-4c16-9b69-b529f0b26f6f', 'ba826d80-ce56-437f-82b0-845b49176326', '74388c52-e608-44d0-a0a6-e1e9e08675db', 'd8e0f5bc-3c2a-4894-94aa-d5883710e3da'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:59 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:19:59 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:59 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.386s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:59 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Deleted volume successfully. Sep 28 16:19:59 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-15daf311-d268-443b-996c-73e8a6706618 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-cf395486-9fb9-4890-8b30-125f6e5f546d-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (71c6df48-86da-4a99-b71b-8385086004b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adba803-4491-41fd-bcbc-14dafb019811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adba803-4491-41fd-bcbc-14dafb019811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501580479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2db751-4a5e-47de-8202-b290a9d26c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:00Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aab11b-8538-444c-ac2d-7db09f0adab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aab11b-8538-444c-ac2d-7db09f0adab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14381a-46e8-4af7-a381-9408970f65c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14381a-46e8-4af7-a381-9408970f65c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2db751-4a5e-47de-8202-b290a9d26c89', 'volume_name': 'volume-1f2db751-4a5e-47de-8202-b290a9d26c89', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b8673e-162a-4c96-821d-e0c0db17fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b8673e-162a-4c96-821d-e0c0db17fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e8e473-ae5a-479a-aa7e-923b9df2d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:00 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Volume 1f2db751-4a5e-47de-8202-b290a9d26c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2db751-4a5e-47de-8202-b290a9d26c89', 'volume_size': 1} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501580479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2db751-4a5e-47de-8202-b290a9d26c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:00Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Creating volume 1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:00 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:00 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 1073741824 Sep 28 16:20:00 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-678e8510-64cf-442a-8646-c5717f107b12-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Lock "cinder-678e8510-64cf-442a-8646-c5717f107b12-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-quobyte-678e8510-64cf-442a-8646-c5717f107b12" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-678e8510-64cf-442a-8646-c5717f107b12" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c937d373-8c52-408f-8b6d-76f001e75264]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:00 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 Sep 28 16:20:00 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:00 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 1073741824" returned: 0 in 0.607s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:00 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 Sep 28 16:20:00 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:01 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12" returned: 0 in 0.523s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:01 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12 Sep 28 16:20:01 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:01 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89" returned: 0 in 0.306s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e8e473-ae5a-479a-aa7e-923b9df2d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2db751-4a5e-47de-8202-b290a9d26c89', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb29327-0cb9-49f7-a567-94f8b59bc5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:01 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Volume volume-1f2db751-4a5e-47de-8202-b290a9d26c89 (1f2db751-4a5e-47de-8202-b290a9d26c89): created successfully Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb29327-0cb9-49f7-a567-94f8b59bc5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (71c6df48-86da-4a99-b71b-8385086004b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f6b71423-471d-4eaf-bce8-c30fc978f942 tempest-ProjectReaderTests-2062210395 None] Created volume successfully. Sep 28 16:20:01 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-678e8510-64cf-442a-8646-c5717f107b12" returned: 0 in 0.360s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-678e8510-64cf-442a-8646-c5717f107b12" released by "delete_volume" :: held 0.957s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Created reservations ['97a937c8-46d7-4854-9318-1845a807ff97', '9ff9919c-6235-4433-b6f8-d7d3763e4e9d', 'd0d37b9c-afc0-4b6b-aa25-22b58ad60822', '3260129d-393d-4934-a665-05f3f29ddc7f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:01 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:01 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:01 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:01 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Deleted volume successfully. Sep 28 16:20:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-8b838675-2d01-403e-b85a-bbea540dc850 tempest-ProjectReaderTests-1304994701 None] Lock "cinder-678e8510-64cf-442a-8646-c5717f107b12-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Creating offline snapshot 61fe7639-a895-401b-b5c1-536511934939 of volume 1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:02 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed4613-26c6-4648-b1ab-47334a55b437]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:02 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 Sep 28 16:20:02 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:03 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89" returned: 0 in 0.516s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:03 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 1G Sep 28 16:20:03 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (48089ae0-93b4-42da-afa7-1f616b851a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e9e8e9-c281-488b-9dac-46abfd2af8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e9e8e9-c281-488b-9dac-46abfd2af8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836183161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afeacdc-ab9c-4466-ba0d-21b14e69eafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:03Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8f3c07-eec3-4682-ad8f-e2ee6c9352eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8f3c07-eec3-4682-ad8f-e2ee6c9352eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49516162-c9c9-4e47-a29c-20953c8a9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49516162-c9c9-4e47-a29c-20953c8a9a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afeacdc-ab9c-4466-ba0d-21b14e69eafa', 'volume_name': 'volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40369a33-805e-4664-980a-bb8d9a7dcd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40369a33-805e-4664-980a-bb8d9a7dcd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea19b68c-3602-4459-b6b7-34a6bda31c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:03 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Volume 6afeacdc-ab9c-4466-ba0d-21b14e69eafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa', 'volume_size': 1} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:03 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 1G" returned: 0 in 0.654s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2db751-4a5e-47de-8202-b290a9d26c89 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:03 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2db751-4a5e-47de-8202-b290a9d26c89 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 Sep 28 16:20:03 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:04 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2db751-4a5e-47de-8202-b290a9d26c89 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939" returned: 0 in 0.412s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:04 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 is being set with open permissions: ugo+rw Sep 28 16:20:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:04 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 Sep 28 16:20:04 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:04 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:04 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info Sep 28 16:20:04 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:04 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info" returned: 0 in 0.337s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:04 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info is being set with open permissions: ugo+rw Sep 28 16:20:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:04 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info Sep 28 16:20:04 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:05 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.info" returned: 0 in 0.342s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836183161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afeacdc-ab9c-4466-ba0d-21b14e69eafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:03Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Creating volume 6afeacdc-ab9c-4466-ba0d-21b14e69eafa {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:05 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa 1073741824 Sep 28 16:20:05 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f7a93ba7-bdfd-45df-9818-84032133af7c tempest-ProjectReaderTests-2062210395 None] Create snapshot completed successfully Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (b4dc976a-713a-41ac-a3e9-d1ff2af70e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3617af0a-aa38-4dc8-8aa6-fa40d543bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3617af0a-aa38-4dc8-8aa6-fa40d543bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585987578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22f79a0-d363-45d0-bf67-a21c043a3491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:05Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69ca8e7-4c25-4a72-8f8e-502fbce818ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69ca8e7-4c25-4a72-8f8e-502fbce818ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b7e208-d7f9-4213-8c40-e26928a9ff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b7e208-d7f9-4213-8c40-e26928a9ff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22f79a0-d363-45d0-bf67-a21c043a3491', 'volume_name': 'volume-e22f79a0-d363-45d0-bf67-a21c043a3491', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a55011-7b92-49eb-b862-c92a2e4c68d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a55011-7b92-49eb-b862-c92a2e4c68d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df28979f-de7b-4d36-8e40-b9f8249ac889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:05 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Volume e22f79a0-d363-45d0-bf67-a21c043a3491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22f79a0-d363-45d0-bf67-a21c043a3491', 'volume_size': 1} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-61fe7639-a895-401b-b5c1-536511934939-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-61fe7639-a895-401b-b5c1-536511934939-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-1f2db751-4a5e-47de-8202-b290a9d26c89" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-1f2db751-4a5e-47de-8202-b290a9d26c89" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-61fe7639-a895-401b-b5c1-536511934939" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-61fe7639-a895-401b-b5c1-536511934939" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Deleting offline snapshot 61fe7639-a895-401b-b5c1-536511934939 of volume 1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] snapshot_file for this snap is: volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f488ec8-8208-4e8c-96ba-a0b8934be18a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa 1073741824" returned: 0 in 0.615s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa Sep 28 16:20:05 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:05 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 Sep 28 16:20:05 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa" returned: 0 in 0.268s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585987578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22f79a0-d363-45d0-bf67-a21c043a3491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:05Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Creating volume e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:06 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea19b68c-3602-4459-b6b7-34a6bda31c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4969038-2f3e-44e8-9599-570df2518a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:06 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 1073741824 Sep 28 16:20:06 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Volume volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa (6afeacdc-ab9c-4466-ba0d-21b14e69eafa): created successfully Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4969038-2f3e-44e8-9599-570df2518a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (48089ae0-93b4-42da-afa7-1f616b851a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:06 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-e08535e8-a0c9-4cea-bdec-8c86b1f0c415 tempest-ProjectReaderTests-1304994701 None] Created volume successfully. Sep 28 16:20:06 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939" returned: 0 in 0.446s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2db751-4a5e-47de-8202-b290a9d26c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[35728458-a958-4ee0-ae25-169bcc4f94db]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 Sep 28 16:20:06 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-6afeacdc-ab9c-4466-ba0d-21b14e69eafa-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 1073741824" returned: 0 in 0.565s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Lock "cinder-6afeacdc-ab9c-4466-ba0d-21b14e69eafa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 Sep 28 16:20:06 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-quobyte-6afeacdc-ab9c-4466-ba0d-21b14e69eafa" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-6afeacdc-ab9c-4466-ba0d-21b14e69eafa" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:06 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89" returned: 0 in 0.582s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899e948-9cec-4aea-9cc3-3c64d2db2891]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 Sep 28 16:20:06 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa Sep 28 16:20:07 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491" returned: 0 in 0.284s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df28979f-de7b-4d36-8e40-b9f8249ac889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22f79a0-d363-45d0-bf67-a21c043a3491', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0eaa7a-ae65-4633-a173-ec75495c64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Volume volume-e22f79a0-d363-45d0-bf67-a21c043a3491 (e22f79a0-d363-45d0-bf67-a21c043a3491): created successfully Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0eaa7a-ae65-4633-a173-ec75495c64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (b4dc976a-713a-41ac-a3e9-d1ff2af70e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-db032060-5d03-4a5c-a563-3fedb4986eb7 tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:20:07 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939" returned: 0 in 0.398s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939 Sep 28 16:20:07 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa" returned: 0 in 0.489s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa Sep 28 16:20:07 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89.61fe7639-a895-401b-b5c1-536511934939" returned: 0 in 0.297s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-61fe7639-a895-401b-b5c1-536511934939" released by "_delete_snapshot" :: held 1.864s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-1f2db751-4a5e-47de-8202-b290a9d26c89" released by "delete_snapshot" :: held 1.893s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:07 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-6afeacdc-ab9c-4466-ba0d-21b14e69eafa" returned: 0 in 0.309s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-6afeacdc-ab9c-4466-ba0d-21b14e69eafa" released by "delete_volume" :: held 0.856s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Created reservations ['e2cfec34-8e1f-423d-8863-3d2043f6c08e', '9e9fc1a8-e17c-4d73-ac4b-43a2483f8d92', '33d3ae2f-9b9e-4fbe-b647-d365e5284c28', '0fcf99df-458a-45f1-b647-28a75f1de279'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Created reservations ['b793d82b-3972-4306-b5dd-1fcd8357fbe5', '66760e1f-6cd5-48ee-b9e4-2b7e1a57aa0b', '9267cad7-f908-47ef-97ae-e52fb90ae166', '692a06bc-bbb4-4ad4-a1d3-52318897b73b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Delete snapshot completed successfully. Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa0deb39-1e6b-414a-a414-ceed3241cf2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-61fe7639-a895-401b-b5c1-536511934939-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:07 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-1f2db751-4a5e-47de-8202-b290a9d26c89-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot 4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab of volume e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Lock "cinder-1f2db751-4a5e-47de-8202-b290a9d26c89-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d6a325-067b-47d5-85c5-6b94a46902eb]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-1f2db751-4a5e-47de-8202-b290a9d26c89" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-1f2db751-4a5e-47de-8202-b290a9d26c89" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e8ae54-d8b4-41fc-9b1f-9f1bca33fba9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:08 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 Sep 28 16:20:08 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:08 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.392s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:08 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Deleted volume successfully. Sep 28 16:20:08 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 Sep 28 16:20:08 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-af5ad787-87e0-4e38-9897-0dde0e71770e tempest-ProjectReaderTests-1304994701 None] Lock "cinder-6afeacdc-ab9c-4466-ba0d-21b14e69eafa-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (217eb510-88ff-43bb-8ff3-daf313b270fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c4a64a-053c-48bf-b670-52edf99b5980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c4a64a-053c-48bf-b670-52edf99b5980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203497908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c248da5d-5747-43c2-9a7b-3e959b5faf26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:09Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:08 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b329b897-d0c6-43ce-a670-b79f378f33b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b329b897-d0c6-43ce-a670-b79f378f33b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7e5449-cc5d-4301-8d22-f11fe2118dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7e5449-cc5d-4301-8d22-f11fe2118dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c248da5d-5747-43c2-9a7b-3e959b5faf26', 'volume_name': 'volume-c248da5d-5747-43c2-9a7b-3e959b5faf26', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f2766-8296-403d-855e-f0b9a8862b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f2766-8296-403d-855e-f0b9a8862b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:08 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ae5a56-0982-42dd-9e43-02358b38e078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:08 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Volume c248da5d-5747-43c2-9a7b-3e959b5faf26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c248da5d-5747-43c2-9a7b-3e959b5faf26', 'volume_size': 1} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491" returned: 0 in 0.627s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89" returned: 0 in 0.511s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:08 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab 1G Sep 28 16:20:08 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:08 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89 Sep 28 16:20:08 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:09 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-1f2db751-4a5e-47de-8202-b290a9d26c89" returned: 0 in 0.285s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-1f2db751-4a5e-47de-8202-b290a9d26c89" released by "delete_volume" :: held 0.881s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Created reservations ['6ab20acb-b609-499b-8aec-b93498dc33ef', 'a54c1b00-3870-4b80-b298-f9973aa94442', '3513af36-85dc-419f-9c33-441cd79bd841', 'b07316b4-ee99-4b6d-8902-8d62992c2246'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:09 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:09 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab 1G" returned: 0 in 0.535s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22f79a0-d363-45d0-bf67-a21c043a3491 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22f79a0-d363-45d0-bf67-a21c043a3491 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab Sep 28 16:20:09 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:09 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:09 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Deleted volume successfully. Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8287737-41f0-499e-95b7-66a113218e9d tempest-ProjectReaderTests-2062210395 None] Lock "cinder-1f2db751-4a5e-47de-8202-b290a9d26c89-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:09 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22f79a0-d363-45d0-bf67-a21c043a3491 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" returned: 0 in 0.393s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:09 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab is being set with open permissions: ugo+rw Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab Sep 28 16:20:09 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (24918783-59bf-4830-b0c6-d5536be7d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e8f61f-8da8-4e1e-adf2-e5bb7f9169fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:09 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e8f61f-8da8-4e1e-adf2-e5bb7f9169fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822835820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb053abf-bfd9-432c-b123-d4337b49ba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:10Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78689cd5-e6fe-4f20-95e2-f5f5613ad08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78689cd5-e6fe-4f20-95e2-f5f5613ad08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33458-0766-4053-8077-415fbf65b3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd33458-0766-4053-8077-415fbf65b3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb053abf-bfd9-432c-b123-d4337b49ba4d', 'volume_name': 'volume-cb053abf-bfd9-432c-b123-d4337b49ba4d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:09 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878481b9-afdd-4655-9789-1d5286c6df57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878481b9-afdd-4655-9789-1d5286c6df57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0052c2e0-76e0-49c8-b3a7-5fe3f1ef9152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:10 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Volume cb053abf-bfd9-432c-b123-d4337b49ba4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb053abf-bfd9-432c-b123-d4337b49ba4d', 'volume_size': 1} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" returned: 0 in 0.338s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:10 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info Sep 28 16:20:10 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:10 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info" returned: 0 in 0.284s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:10 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info is being set with open permissions: ugo+rw Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:10 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info Sep 28 16:20:10 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:10 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.info" returned: 0 in 0.257s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.594s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203497908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c248da5d-5747-43c2-9a7b-3e959b5faf26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:09Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Creating volume c248da5d-5747-43c2-9a7b-3e959b5faf26 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:10 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:10 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 1073741824 Sep 28 16:20:10 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9f6412d9-0748-45be-8e66-f12097dc169e tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:20:11 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 1073741824" returned: 0 in 0.480s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:11 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 Sep 28 16:20:11 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-e22f79a0-d363-45d0-bf67-a21c043a3491" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-e22f79a0-d363-45d0-bf67-a21c043a3491" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot 4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab of volume e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[516eac96-c007-447a-bb80-d7ba17ba93ba]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:11 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26" returned: 0 in 0.266s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822835820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb053abf-bfd9-432c-b123-d4337b49ba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:10Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Creating volume cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:11 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ae5a56-0982-42dd-9e43-02358b38e078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c248da5d-5747-43c2-9a7b-3e959b5faf26', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718cb9c6-8687-4321-a0d5-2a162bc5b408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:11 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d 1073741824 Sep 28 16:20:11 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Volume volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 (c248da5d-5747-43c2-9a7b-3e959b5faf26): created successfully Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718cb9c6-8687-4321-a0d5-2a162bc5b408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (217eb510-88ff-43bb-8ff3-daf313b270fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:11 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-8c9d7106-9693-4ec4-a196-d65496fde0a6 tempest-ProjectReaderTests-1304994701 None] Created volume successfully. Sep 28 16:20:11 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab Sep 28 16:20:11 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:11 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" returned: 0 in 0.524s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e22f79a0-d363-45d0-bf67-a21c043a3491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e098d2-955e-4702-8270-2c2cd00f3737]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-c248da5d-5747-43c2-9a7b-3e959b5faf26-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Lock "cinder-c248da5d-5747-43c2-9a7b-3e959b5faf26-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:12 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d 1073741824" returned: 0 in 0.647s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-quobyte-c248da5d-5747-43c2-9a7b-3e959b5faf26" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:12 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 Sep 28 16:20:12 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-c248da5d-5747-43c2-9a7b-3e959b5faf26" acquired by "delete_volume" :: waited 0.041s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:12 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d Sep 28 16:20:12 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a43c1-bede-484b-912d-b19b85912ca9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 Sep 28 16:20:12 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0052c2e0-76e0-49c8-b3a7-5fe3f1ef9152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb053abf-bfd9-432c-b123-d4337b49ba4d', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:12 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3229f5-032e-40c7-8bfd-85ec1ffa2dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491" returned: 0 in 0.503s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Volume volume-cb053abf-bfd9-432c-b123-d4337b49ba4d (cb053abf-bfd9-432c-b123-d4337b49ba4d): created successfully Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3229f5-032e-40c7-8bfd-85ec1ffa2dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:12 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab Sep 28 16:20:12 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (24918783-59bf-4830-b0c6-d5536be7d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:12 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-66aa7c2a-f65d-423a-bf47-16672740bf22 tempest-ProjectReaderTests-2062210395 None] Created volume successfully. Sep 28 16:20:12 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26" returned: 0 in 0.467s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26 Sep 28 16:20:12 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab Sep 28 16:20:12 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-c248da5d-5747-43c2-9a7b-3e959b5faf26" returned: 0 in 0.293s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-c248da5d-5747-43c2-9a7b-3e959b5faf26" released by "delete_volume" :: held 0.818s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Created reservations ['c2412aa8-43ec-40d3-9c7c-0a051c57a18d', 'e2ae7c5f-2431-471e-905e-cd4b2294189d', '2e3f170e-aec7-4588-b5f1-169615945b8c', '8513280f-7a05-4afd-b004-db6fdc97ff97'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:13 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:13 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:13 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491.4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" returned: 0 in 0.342s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab" released by "_delete_snapshot" :: held 1.965s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-e22f79a0-d363-45d0-bf67-a21c043a3491" released by "delete_snapshot" :: held 2.002s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Creating offline snapshot b71b8395-eb48-4c34-818a-6983e2b5439e of volume cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d7f3c-4ede-46f8-a35e-482a5b8c0df4]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Created reservations ['810f667e-7eaa-48e4-b7ce-99d01c3b3bc3', '5cda3bea-98c0-4487-a98d-324352d01c7f', 'c1ee6db3-a459-4b4f-88c4-9fef4fac4bee', 'a414e999-b172-42e8-b9ce-8c10fee48bb2'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:13 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:13 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d Sep 28 16:20:13 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Deleted volume successfully. Sep 28 16:20:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-aa4a846c-b03b-4018-afd1-874347cc250a tempest-ProjectReaderTests-1304994701 None] Lock "cinder-c248da5d-5747-43c2-9a7b-3e959b5faf26-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-d5f5ff82-0ebe-4124-920a-642672078395 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-4109e8fd-5cb3-4b5b-8dfd-4efc5ee7dbab-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d" returned: 0 in 0.427s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:13 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e 1G Sep 28 16:20:13 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (7aad11d3-4b3b-41d2-b70c-023eda13ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644696c3-1ab4-4b3a-be19-ce89506c5ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644696c3-1ab4-4b3a-be19-ce89506c5ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074863303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5da621-f9d0-459b-bf02-a849fbbf5281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:14Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb9a062-d54f-4cd6-a94e-a8576ada40ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb9a062-d54f-4cd6-a94e-a8576ada40ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b6f1ec-6d2c-43fa-a1a2-f0dcebde48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b6f1ec-6d2c-43fa-a1a2-f0dcebde48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5da621-f9d0-459b-bf02-a849fbbf5281', 'volume_name': 'volume-7a5da621-f9d0-459b-bf02-a849fbbf5281', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ba80c8-cdd4-4365-852d-fa99f19be9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ba80c8-cdd4-4365-852d-fa99f19be9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162f02df-07d6-4ba6-a1b7-befe775e06bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:13 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Volume 7a5da621-f9d0-459b-bf02-a849fbbf5281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5da621-f9d0-459b-bf02-a849fbbf5281', 'volume_size': 1} Sep 28 16:20:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:14 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e 1G" returned: 0 in 0.421s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb053abf-bfd9-432c-b123-d4337b49ba4d -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:14 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb053abf-bfd9-432c-b123-d4337b49ba4d -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e Sep 28 16:20:14 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-e22f79a0-d363-45d0-bf67-a21c043a3491-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-e22f79a0-d363-45d0-bf67-a21c043a3491-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-e22f79a0-d363-45d0-bf67-a21c043a3491" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:14 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-e22f79a0-d363-45d0-bf67-a21c043a3491" acquired by "delete_volume" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb053abf-bfd9-432c-b123-d4337b49ba4d -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e" returned: 0 in 0.412s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:14 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e is being set with open permissions: ugo+rw Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6994a1-3e92-4d5a-b303-eaa7ace45d78]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:14 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e Sep 28 16:20:14 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:14 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 Sep 28 16:20:14 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:14 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e" returned: 0 in 0.280s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:15 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info Sep 28 16:20:15 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:15 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491" returned: 0 in 0.413s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:15 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491 Sep 28 16:20:15 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:15 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info" returned: 0 in 0.320s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:15 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info is being set with open permissions: ugo+rw Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:15 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info Sep 28 16:20:15 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:15 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-e22f79a0-d363-45d0-bf67-a21c043a3491" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-e22f79a0-d363-45d0-bf67-a21c043a3491" released by "delete_volume" :: held 0.832s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Created reservations ['68208829-368f-4d0a-8f69-b1be736f4571', '37455273-4224-4a31-828b-4225fb653849', '511f94e1-d11c-4af3-8103-2e7baa88cdec', '4bbedc11-0e53-47b2-968c-06f64ff670ad'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:15 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.info" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074863303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5da621-f9d0-459b-bf02-a849fbbf5281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3421d7c99edf4047a97550e12bc9f3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:14Z,use_quota=True,user_id='8e676419272e43a39989f43de25e8cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Creating volume 7a5da621-f9d0-459b-bf02-a849fbbf5281 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:15 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:15 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 1073741824 Sep 28 16:20:15 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ce685410-c991-46ee-a129-905be0b6c06c tempest-ProjectReaderTests-2062210395 None] Create snapshot completed successfully Sep 28 16:20:15 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:15 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:16 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-540c37e6-8260-4916-be8f-e2343daa1356 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-e22f79a0-d363-45d0-bf67-a21c043a3491-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:16 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 1073741824" returned: 0 in 0.591s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:16 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 Sep 28 16:20:16 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (39c2bd1f-f2f3-43d4-98da-a1fdca9a3814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5129ae6-28e8-4a5a-814d-be819bfb1503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5129ae6-28e8-4a5a-814d-be819bfb1503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237033251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51dd3ab-527c-456c-a2c4-3cdf0d54e94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:16Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0e4a9b-f654-4e08-951c-229872602752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0e4a9b-f654-4e08-951c-229872602752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cb5b26-f072-4cfd-a717-a92ddb38ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cb5b26-f072-4cfd-a717-a92ddb38ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51dd3ab-527c-456c-a2c4-3cdf0d54e94c', 'volume_name': 'volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913e89d3-7c6d-449f-ab69-885dcad291d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913e89d3-7c6d-449f-ab69-885dcad291d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df67af0d-43f4-4f22-98eb-c525669a66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Volume b51dd3ab-527c-456c-a2c4-3cdf0d54e94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c', 'volume_size': 1} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-b71b8395-eb48-4c34-818a-6983e2b5439e-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-b71b8395-eb48-4c34-818a-6983e2b5439e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-cb053abf-bfd9-432c-b123-d4337b49ba4d" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:16 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281" returned: 0 in 0.291s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237033251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51dd3ab-527c-456c-a2c4-3cdf0d54e94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:16Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Creating volume b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:16 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cb053abf-bfd9-432c-b123-d4337b49ba4d" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-b71b8395-eb48-4c34-818a-6983e2b5439e" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:16 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c 1073741824 Sep 28 16:20:16 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162f02df-07d6-4ba6-a1b7-befe775e06bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5da621-f9d0-459b-bf02-a849fbbf5281', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79b95b2-5d29-4fb7-a559-245cb6f0e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-b71b8395-eb48-4c34-818a-6983e2b5439e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Deleting offline snapshot b71b8395-eb48-4c34-818a-6983e2b5439e of volume cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] snapshot_file for this snap is: volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Volume volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 (7a5da621-f9d0-459b-bf02-a849fbbf5281): created successfully Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79b95b2-5d29-4fb7-a559-245cb6f0e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Flow 'volume_create_manager' (7aad11d3-4b3b-41d2-b70c-023eda13ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2468ee5-4c33-4b7f-b681-142c7f5625e6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-47b2270e-0658-48d8-84c9-6e4ff4e448ad tempest-ProjectReaderTests-1304994701 None] Created volume successfully. Sep 28 16:20:16 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e Sep 28 16:20:16 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-7a5da621-f9d0-459b-bf02-a849fbbf5281-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Lock "cinder-7a5da621-f9d0-459b-bf02-a849fbbf5281-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:17 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c 1073741824" returned: 0 in 0.529s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Acquiring lock "cinder-quobyte-7a5da621-f9d0-459b-bf02-a849fbbf5281" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:17 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-7a5da621-f9d0-459b-bf02-a849fbbf5281" acquired by "delete_volume" :: waited 0.046s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:17 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c Sep 28 16:20:17 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e" returned: 0 in 0.518s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb053abf-bfd9-432c-b123-d4337b49ba4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6f120-f797-42cf-9c71-b67f49ec865c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[647364dd-240a-4675-8877-d0f9866b7bed]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:17 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 Sep 28 16:20:17 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:17 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d Sep 28 16:20:17 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:17 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" returned: 0 in 0.287s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df67af0d-43f4-4f22-98eb-c525669a66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d395a7d6-72c3-420b-ab09-5be4ba6df8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:17 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Volume volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c (b51dd3ab-527c-456c-a2c4-3cdf0d54e94c): created successfully Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d395a7d6-72c3-420b-ab09-5be4ba6df8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (39c2bd1f-f2f3-43d4-98da-a1fdca9a3814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:17 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-958e19da-910e-4ffa-a8f5-6d5d583baacb tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:20:17 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281" returned: 0 in 0.419s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:17 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d" returned: 0 in 0.414s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:17 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281 Sep 28 16:20:17 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:17 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e Sep 28 16:20:17 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:17 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-7a5da621-f9d0-459b-bf02-a849fbbf5281" returned: 0 in 0.278s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:17 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Lock "cinder-quobyte-7a5da621-f9d0-459b-bf02-a849fbbf5281" released by "delete_volume" :: held 0.754s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:18 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e" returned: 0 in 0.354s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Created reservations ['bf75d601-d97f-4739-af14-7b478df73e3b', '2df5f9d5-9dba-4823-a9ae-f3dc34f4fb34', '39ccf493-cf00-4c86-b12a-ee9d75f73d79', '20b67f40-d6fc-4f8d-ab3c-7e7774e3ac09'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:18 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e Sep 28 16:20:18 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:18 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:18 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:18 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d.b71b8395-eb48-4c34-818a-6983e2b5439e" returned: 0 in 0.295s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-b71b8395-eb48-4c34-818a-6983e2b5439e" released by "_delete_snapshot" :: held 1.721s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cb053abf-bfd9-432c-b123-d4337b49ba4d" released by "delete_snapshot" :: held 1.776s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:18 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.294s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Deleted volume successfully. Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Created reservations ['9ae89750-0cbb-4c76-9727-c6bb0b443060', '955e9705-fdcf-408a-b8e5-b45675564f5e', '75a8b9e8-6316-44a1-96b4-078168bab1c3', 'aa74ac4e-9cd3-462a-bd9d-5fd1216491db'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-b8bb3d6f-fd1a-4ef5-b56c-a3da8589954f tempest-ProjectReaderTests-1304994701 None] Lock "cinder-7a5da621-f9d0-459b-bf02-a849fbbf5281-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:18 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Delete snapshot completed successfully. Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-be4b1bfc-1612-45bf-9906-a3fbab06ebb3 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-b71b8395-eb48-4c34-818a-6983e2b5439e-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot 6b90603f-c339-45b9-ae96-56904fbb2a55 of volume b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3920461-7f57-45a6-b517-41cea490a85b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:19 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c Sep 28 16:20:19 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:19 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" returned: 0 in 0.444s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:19 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 1G Sep 28 16:20:19 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-cb053abf-bfd9-432c-b123-d4337b49ba4d-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-cb053abf-bfd9-432c-b123-d4337b49ba4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-cb053abf-bfd9-432c-b123-d4337b49ba4d" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cb053abf-bfd9-432c-b123-d4337b49ba4d" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:19 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 1G" returned: 0 in 0.642s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0395264-a2f7-4464-be36-1c3f64232d6a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:19 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:20 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 Sep 28 16:20:20 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:20 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d Sep 28 16:20:20 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:20 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55" returned: 0 in 0.436s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:20 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 is being set with open permissions: ugo+rw Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:20 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 Sep 28 16:20:20 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:20 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d" returned: 0 in 0.475s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:20 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d Sep 28 16:20:20 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:20 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55" returned: 0 in 0.271s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:20 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info Sep 28 16:20:20 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:20 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cb053abf-bfd9-432c-b123-d4337b49ba4d" returned: 0 in 0.341s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-cb053abf-bfd9-432c-b123-d4337b49ba4d" released by "delete_volume" :: held 0.923s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Created reservations ['34fc6fb8-c7bb-4678-a3c1-9a2891db055f', 'c6c61641-9395-429f-8e16-dbd1635aca0b', 'a0b73c0c-9a92-4fc9-ba0c-de36127880cd', '95f3d645-0fde-4f57-95a2-4fb41def3e34'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:20 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:21 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info" returned: 0 in 0.326s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:21 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info is being set with open permissions: ugo+rw Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:21 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:21 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:21 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info Sep 28 16:20:21 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:21 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.info" returned: 0 in 0.251s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:21 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:21 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Deleted volume successfully. Sep 28 16:20:21 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-998c7c47-ba4d-4055-8f8b-81e8047ae7eb tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-4d5afcac-d1bb-4bf3-a716-b4c8e9fba704 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-cb053abf-bfd9-432c-b123-d4337b49ba4d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (a93a71b2-6a9a-4ff6-b405-c7174863f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53cc9b3-7203-4af6-971d-32dae4cbc243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53cc9b3-7203-4af6-971d-32dae4cbc243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948044275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88cc779-a94a-4a96-be02-a025110c7ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:22Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c458d95-fe03-42f2-ac70-219fd18050ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c458d95-fe03-42f2-ac70-219fd18050ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c14610-a61e-4eda-93ea-018c80a79502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c14610-a61e-4eda-93ea-018c80a79502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88cc779-a94a-4a96-be02-a025110c7ced', 'volume_name': 'volume-f88cc779-a94a-4a96-be02-a025110c7ced', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec0f1f2-710b-42f7-80a2-f1fa4981353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec0f1f2-710b-42f7-80a2-f1fa4981353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e89311-b902-454c-be88-7702f4861a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:21 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Volume f88cc779-a94a-4a96-be02-a025110c7ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88cc779-a94a-4a96-be02-a025110c7ced', 'volume_size': 1} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948044275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88cc779-a94a-4a96-be02-a025110c7ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:22Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Creating volume f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:21 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:21 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced 1073741824 Sep 28 16:20:21 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:21 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-6b90603f-c339-45b9-ae96-56904fbb2a55-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-6b90603f-c339-45b9-ae96-56904fbb2a55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-6b90603f-c339-45b9-ae96-56904fbb2a55" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-6b90603f-c339-45b9-ae96-56904fbb2a55" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot 6b90603f-c339-45b9-ae96-56904fbb2a55 of volume b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1930f5-d7f1-4b22-9e80-e24d92d0a0c1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:22 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced 1073741824" returned: 0 in 0.495s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:22 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced Sep 28 16:20:22 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:22 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 Sep 28 16:20:22 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:22 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced" returned: 0 in 0.270s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e89311-b902-454c-be88-7702f4861a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88cc779-a94a-4a96-be02-a025110c7ced', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ec5ff0-a3b0-4765-884a-4ae813b8ec9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:22 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Volume volume-f88cc779-a94a-4a96-be02-a025110c7ced (f88cc779-a94a-4a96-be02-a025110c7ced): created successfully Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ec5ff0-a3b0-4765-884a-4ae813b8ec9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:22 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (a93a71b2-6a9a-4ff6-b405-c7174863f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:22 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-79e37009-1b09-45ff-a366-a73c86bc1d4e tempest-ProjectReaderTests-2062210395 None] Created volume successfully. Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ff369-2444-4999-9df3-a089a93591f7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:22 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c Sep 28 16:20:22 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:22 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" returned: 0 in 0.361s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:22 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:22 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 Sep 28 16:20:22 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:23 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55" returned: 0 in 0.340s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:23 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55 Sep 28 16:20:23 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:23 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c.6b90603f-c339-45b9-ae96-56904fbb2a55" returned: 0 in 0.249s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-6b90603f-c339-45b9-ae96-56904fbb2a55" released by "_delete_snapshot" :: held 1.494s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" released by "delete_snapshot" :: held 1.517s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Created reservations ['9e470076-03c9-4ce9-85f0-af6ffac17883', '8440f2f8-71a9-43ac-83f6-7f70c3c7850b', 'f46c01e9-6f44-4523-a5bc-c95d904e05bc', '69a848ee-88cf-409a-b993-b695fff30f35'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:23 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3cc75b76-c977-4e33-b74e-38154184a6e5 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-6b90603f-c339-45b9-ae96-56904fbb2a55-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Creating offline snapshot bad6c745-db04-4ece-9384-1e5ccbf982a4 of volume f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd9c08-002a-4cd5-87bf-967a68390985]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:24 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced Sep 28 16:20:24 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" acquired by "delete_volume" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a174f0-9af9-43c8-897c-8549aaae744b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:24 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced" returned: 0 in 0.440s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:24 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 1G Sep 28 16:20:24 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:24 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c Sep 28 16:20:24 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:24 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:24 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c Sep 28 16:20:24 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:24 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 1G" returned: 0 in 0.451s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88cc779-a94a-4a96-be02-a025110c7ced -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:24 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88cc779-a94a-4a96-be02-a025110c7ced -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 Sep 28 16:20:24 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:25 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" returned: 0 in 0.285s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c" released by "delete_volume" :: held 0.775s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Created reservations ['e9a3f1d1-a6c3-4686-b073-c322734a7a76', '2a97a49a-1b38-41be-917a-86bdd9da6d96', '9bb7eef9-06bf-412f-9f30-46b7c59be30a', '828e5063-fb20-49d4-a796-bd4f39ab2388'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:25 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88cc779-a94a-4a96-be02-a025110c7ced -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4" returned: 0 in 0.331s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:25 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 is being set with open permissions: ugo+rw Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:25 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 Sep 28 16:20:25 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:25 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:25 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:25 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4" returned: 0 in 0.302s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:25 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info Sep 28 16:20:25 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:25 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.293s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:25 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-248b3104-a835-44a6-9615-96e41cd54aa6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-b51dd3ab-527c-456c-a2c4-3cdf0d54e94c-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:25 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info" returned: 0 in 0.306s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:25 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info is being set with open permissions: ugo+rw Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:25 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info Sep 28 16:20:25 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:25 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (8d7a26ff-50c8-49e1-82c9-65399e9a5285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0b80d7-53ab-4eda-9c03-1a7dde757df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0b80d7-53ab-4eda-9c03-1a7dde757df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1099515150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c54f601-2547-466e-ab5b-3780d77ad5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:26Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c31995-14de-475f-8bdc-d894f80f0b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c31995-14de-475f-8bdc-d894f80f0b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbadc5f0-bfd7-4b9b-aeac-b106bcca9d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbadc5f0-bfd7-4b9b-aeac-b106bcca9d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c54f601-2547-466e-ab5b-3780d77ad5f3', 'volume_name': 'volume-9c54f601-2547-466e-ab5b-3780d77ad5f3', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33dac74-8967-4002-959a-c62f058e8044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33dac74-8967-4002-959a-c62f058e8044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560f0349-a01c-4c2f-aec1-c0609b2f68e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:26 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Volume 9c54f601-2547-466e-ab5b-3780d77ad5f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c54f601-2547-466e-ab5b-3780d77ad5f3', 'volume_size': 1} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:26 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.info" returned: 0 in 0.296s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1099515150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c54f601-2547-466e-ab5b-3780d77ad5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:26Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Creating volume 9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:26 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:26 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 1073741824 Sep 28 16:20:26 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-148f7cea-d73b-444d-bbc5-6839c7a9ac75 tempest-ProjectReaderTests-2062210395 None] Create snapshot completed successfully Sep 28 16:20:26 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 1073741824" returned: 0 in 0.442s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:26 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 Sep 28 16:20:26 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:26 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:26 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:26 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3" returned: 0 in 0.273s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560f0349-a01c-4c2f-aec1-c0609b2f68e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c54f601-2547-466e-ab5b-3780d77ad5f3', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b648f947-f0ff-453b-8821-476bbc4f1bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:26 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Volume volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 (9c54f601-2547-466e-ab5b-3780d77ad5f3): created successfully Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b648f947-f0ff-453b-8821-476bbc4f1bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:26 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (8d7a26ff-50c8-49e1-82c9-65399e9a5285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-783ec16c-6a0b-44ea-ab72-e87df4adf8b0 tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:20:27 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.310s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-bad6c745-db04-4ece-9384-1e5ccbf982a4-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-bad6c745-db04-4ece-9384-1e5ccbf982a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-f88cc779-a94a-4a96-be02-a025110c7ced" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-f88cc779-a94a-4a96-be02-a025110c7ced" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-bad6c745-db04-4ece-9384-1e5ccbf982a4" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-bad6c745-db04-4ece-9384-1e5ccbf982a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Deleting offline snapshot bad6c745-db04-4ece-9384-1e5ccbf982a4 of volume f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] snapshot_file for this snap is: volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97afdfb-7448-4a28-8bc8-43d4ffca0200]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:27 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 Sep 28 16:20:27 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:27 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4" returned: 0 in 0.376s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f88cc779-a94a-4a96-be02-a025110c7ced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c234a8-9299-4117-9e56-75e8066c3f24]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:27 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced Sep 28 16:20:27 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:28 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced" returned: 0 in 0.399s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:28 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 Sep 28 16:20:28 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot c1acbf4f-bead-46e2-8354-58d8bc42b49e of volume 9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c63ffb-05c7-4257-b13c-ede61d66e550]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:28 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4" returned: 0 in 0.372s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:28 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 Sep 28 16:20:28 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:28 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4 Sep 28 16:20:28 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:28 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced.bad6c745-db04-4ece-9384-1e5ccbf982a4" returned: 0 in 0.264s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:28 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3" returned: 0 in 0.418s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-bad6c745-db04-4ece-9384-1e5ccbf982a4" released by "_delete_snapshot" :: held 1.529s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-f88cc779-a94a-4a96-be02-a025110c7ced" released by "delete_snapshot" :: held 1.555s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:28 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e 1G Sep 28 16:20:28 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Created reservations ['1f2faaa9-29b4-4f69-af10-7f28969babc1', 'cb9891a2-5688-4727-a7fc-232c01380e4e', 'bb5e40bf-b09f-4a08-9e5e-e585d17d04ce', 'ca2c6f6d-538a-4638-ba0a-a8fb3acef4fd'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Delete snapshot completed successfully. Sep 28 16:20:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-fe1e1cce-5770-4d37-b986-1d19ffdb7835 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-bad6c745-db04-4ece-9384-1e5ccbf982a4-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:29 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e 1G" returned: 0 in 0.417s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:29 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e Sep 28 16:20:29 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-f88cc779-a94a-4a96-be02-a025110c7ced-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-f88cc779-a94a-4a96-be02-a025110c7ced-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-f88cc779-a94a-4a96-be02-a025110c7ced" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-f88cc779-a94a-4a96-be02-a025110c7ced" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:29 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e" returned: 0 in 0.368s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:29 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e is being set with open permissions: ugo+rw Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19123e-7fa0-409b-aab6-ed5b9414ea39]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:29 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e Sep 28 16:20:29 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:29 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced Sep 28 16:20:29 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:29 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e" returned: 0 in 0.281s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:29 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info Sep 28 16:20:29 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:29 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced" returned: 0 in 0.423s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:29 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced Sep 28 16:20:29 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:30 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info" returned: 0 in 0.301s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:30 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info is being set with open permissions: ugo+rw Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:30 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info Sep 28 16:20:30 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:30 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-f88cc779-a94a-4a96-be02-a025110c7ced" returned: 0 in 0.293s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-f88cc779-a94a-4a96-be02-a025110c7ced" released by "delete_volume" :: held 0.824s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Created reservations ['5698f2d8-4940-482a-ab10-73e2bed3cad5', '31dca7ad-ea29-4a21-b85a-6aeaa22faeb3', 'e56a3c8f-937e-4b0d-966a-f501f2cd3302', '12e3be8d-4785-40d2-a507-c9c87139fe30'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:30 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.info" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:30 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:30 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-368537d4-0306-49b0-9020-36ec359c9266 tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:20:30 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.295s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Deleted volume successfully. Sep 28 16:20:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-12c5ac60-f237-4692-9e10-916eac75ea2c tempest-ProjectReaderTests-2062210395 None] Lock "cinder-f88cc779-a94a-4a96-be02-a025110c7ced-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (a27cd6bb-6a27-49e6-b4d8-2f889b5205da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef319c3c-e252-41ab-a204-cb9f5e5c227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef319c3c-e252-41ab-a204-cb9f5e5c227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364080419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92c9e39-f510-48bc-ba4b-10daab6fb843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:31Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e50b667-62cf-4e24-9a44-a0bf1ea63592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e50b667-62cf-4e24-9a44-a0bf1ea63592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cfe786-c481-4c0d-b700-ea4b8396df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cfe786-c481-4c0d-b700-ea4b8396df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92c9e39-f510-48bc-ba4b-10daab6fb843', 'volume_name': 'volume-a92c9e39-f510-48bc-ba4b-10daab6fb843', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d31ce3-3aa4-4562-82d4-4fbdbccdca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d31ce3-3aa4-4562-82d4-4fbdbccdca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256e81af-1e72-49ea-98e7-d84a197dbbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:31 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Volume a92c9e39-f510-48bc-ba4b-10daab6fb843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92c9e39-f510-48bc-ba4b-10daab6fb843', 'volume_size': 1} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1364080419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92c9e39-f510-48bc-ba4b-10daab6fb843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae846e570ad48b989f731ce425d005d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:31Z,use_quota=True,user_id='cf94101d0e804bacbefd6c4788286031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Creating volume a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:31 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:31 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 1073741824 Sep 28 16:20:31 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-c1acbf4f-bead-46e2-8354-58d8bc42b49e-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-c1acbf4f-bead-46e2-8354-58d8bc42b49e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-9c54f601-2547-466e-ab5b-3780d77ad5f3" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-9c54f601-2547-466e-ab5b-3780d77ad5f3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-c1acbf4f-bead-46e2-8354-58d8bc42b49e" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-c1acbf4f-bead-46e2-8354-58d8bc42b49e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot c1acbf4f-bead-46e2-8354-58d8bc42b49e of volume 9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6847f8-4e13-47f4-b72b-ba36ea1e5a5e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:31 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e Sep 28 16:20:31 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:31 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 1073741824" returned: 0 in 0.512s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:31 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 Sep 28 16:20:31 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:31 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c54f601-2547-466e-ab5b-3780d77ad5f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[841fe123-2e73-44b0-9e7f-be4a8aea2d9d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:32 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843" returned: 0 in 0.325s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256e81af-1e72-49ea-98e7-d84a197dbbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92c9e39-f510-48bc-ba4b-10daab6fb843', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14705951-80ee-466a-b960-b4b3d5659f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:32 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Volume volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 (a92c9e39-f510-48bc-ba4b-10daab6fb843): created successfully Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14705951-80ee-466a-b960-b4b3d5659f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:32 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 Sep 28 16:20:32 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Flow 'volume_create_manager' (a27cd6bb-6a27-49e6-b4d8-2f889b5205da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-78886b58-31a9-4f6c-9d2f-aab63abaabdb tempest-ProjectReaderTests-2062210395 None] Created volume successfully. Sep 28 16:20:32 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3" returned: 0 in 0.414s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:32 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e Sep 28 16:20:32 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:32 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e" returned: 0 in 0.372s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:32 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e Sep 28 16:20:32 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:33 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3.c1acbf4f-bead-46e2-8354-58d8bc42b49e" returned: 0 in 0.262s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-c1acbf4f-bead-46e2-8354-58d8bc42b49e" released by "_delete_snapshot" :: held 1.574s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-9c54f601-2547-466e-ab5b-3780d77ad5f3" released by "delete_snapshot" :: held 1.601s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Created reservations ['b01c06c6-3bcf-4a25-91e8-ce3da0334538', '5417fb80-05c5-42c0-8e03-ea9584d8d5eb', 'b5e7cf63-bc34-4e77-a681-606777d9a4d0', '1fc37971-8af1-4947-810f-1ef9267fb7f5'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:33 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-5cfe7ab3-504d-4ded-b6f9-360ce1e35276 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-c1acbf4f-bead-46e2-8354-58d8bc42b49e-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Creating offline snapshot ce7e9b00-292b-4c6e-a0dc-92115dd33210 of volume a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f34ad2f-4a18-4dfc-8141-e79fbc9fd8c7]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:33 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 Sep 28 16:20:33 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-9c54f601-2547-466e-ab5b-3780d77ad5f3-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-9c54f601-2547-466e-ab5b-3780d77ad5f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-9c54f601-2547-466e-ab5b-3780d77ad5f3" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-9c54f601-2547-466e-ab5b-3780d77ad5f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf6964-29df-47bc-bbaa-43ecfff6ecee]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:33 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843" returned: 0 in 0.412s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:33 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 1G Sep 28 16:20:33 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:33 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 Sep 28 16:20:33 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:34 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3" returned: 0 in 0.432s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:34 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3 Sep 28 16:20:34 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:34 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 1G" returned: 0 in 0.511s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:34 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 Sep 28 16:20:34 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:34 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-9c54f601-2547-466e-ab5b-3780d77ad5f3" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-9c54f601-2547-466e-ab5b-3780d77ad5f3" released by "delete_volume" :: held 0.840s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Created reservations ['8d9a0af3-a351-4fef-861d-cbfaebea723b', 'a4f7f694-4c0e-4776-ae83-62ab65b83914', '65440acd-aeb8-4176-ab1e-0a8249963eb6', '2dd84d23-f243-4dfc-9911-8e9fc7b83692'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:34 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210" returned: 0 in 0.403s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:34 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 is being set with open permissions: ugo+rw Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:34 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:34 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:34 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 Sep 28 16:20:34 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:34 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.291s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:34 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:34 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1e34d31f-0315-41ba-bc1f-6e8427b30923 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-9c54f601-2547-466e-ab5b-3780d77ad5f3-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:35 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210" returned: 0 in 0.318s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:35 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info Sep 28 16:20:35 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:35 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (d977c2c5-0dbc-40ef-a895-1f1799aa9d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ee040-2eea-4371-9d45-650c1f580157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:35 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info is being set with open permissions: ugo+rw Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ee040-2eea-4371-9d45-650c1f580157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230298759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140cefbf-05e6-46e9-9799-69407d526ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:35Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:35 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d3a927-d1ca-4477-9869-45e3150afb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:35 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d3a927-d1ca-4477-9869-45e3150afb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d426467e-2bb3-4e03-bf4c-8fe085e7bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d426467e-2bb3-4e03-bf4c-8fe085e7bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140cefbf-05e6-46e9-9799-69407d526ab2', 'volume_name': 'volume-140cefbf-05e6-46e9-9799-69407d526ab2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637a8a52-9f21-4292-9eab-ac1fb42170c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637a8a52-9f21-4292-9eab-ac1fb42170c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518ab5bf-6171-4fd2-a519-c75ad93400df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:35 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Volume 140cefbf-05e6-46e9-9799-69407d526ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140cefbf-05e6-46e9-9799-69407d526ab2', 'volume_size': 1} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:35 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.info" returned: 0 in 0.327s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230298759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140cefbf-05e6-46e9-9799-69407d526ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:35Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Creating volume 140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:35 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:35 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 1073741824 Sep 28 16:20:35 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:35 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ff3df9f3-b1db-495f-a26b-2ca1cfb374c6 tempest-ProjectReaderTests-2062210395 None] Create snapshot completed successfully Sep 28 16:20:36 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 1073741824" returned: 0 in 0.531s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:36 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 Sep 28 16:20:36 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-ce7e9b00-292b-4c6e-a0dc-92115dd33210-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-ce7e9b00-292b-4c6e-a0dc-92115dd33210-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-a92c9e39-f510-48bc-ba4b-10daab6fb843" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-a92c9e39-f510-48bc-ba4b-10daab6fb843" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-ce7e9b00-292b-4c6e-a0dc-92115dd33210" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-ce7e9b00-292b-4c6e-a0dc-92115dd33210" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Deleting offline snapshot ce7e9b00-292b-4c6e-a0dc-92115dd33210 of volume a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:36 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] snapshot_file for this snap is: volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2" returned: 0 in 0.374s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e035906e-f6aa-400f-bac7-827dac4e6ec1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518ab5bf-6171-4fd2-a519-c75ad93400df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140cefbf-05e6-46e9-9799-69407d526ab2', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113a1805-6f64-4587-8248-09b757df774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:36 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Volume volume-140cefbf-05e6-46e9-9799-69407d526ab2 (140cefbf-05e6-46e9-9799-69407d526ab2): created successfully Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113a1805-6f64-4587-8248-09b757df774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:36 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (d977c2c5-0dbc-40ef-a895-1f1799aa9d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7d3b520e-b49f-4f37-a308-f92f5bb4885d tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:20:36 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 Sep 28 16:20:36 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:37 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210" returned: 0 in 0.469s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a92c9e39-f510-48bc-ba4b-10daab6fb843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b66155-d3f0-4bc4-9d8a-2317dc3e3f82]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:37 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 Sep 28 16:20:37 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot a8447352-ccfa-4ff1-944c-55495430acc4 of volume 140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc88b9-1484-4a37-a40f-1a3a8846df90]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:37 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843" returned: 0 in 0.498s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:37 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 Sep 28 16:20:37 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:37 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 Sep 28 16:20:37 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:38 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210" returned: 0 in 0.404s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:38 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210 Sep 28 16:20:38 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:38 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2" returned: 0 in 0.470s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:38 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 1G Sep 28 16:20:38 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:38 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843.ce7e9b00-292b-4c6e-a0dc-92115dd33210" returned: 0 in 0.298s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-ce7e9b00-292b-4c6e-a0dc-92115dd33210" released by "_delete_snapshot" :: held 1.799s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-a92c9e39-f510-48bc-ba4b-10daab6fb843" released by "delete_snapshot" :: held 1.831s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Created reservations ['542a3f9f-3a7b-4cf8-b100-c69f9df28dfd', 'daee461d-0db7-412e-8985-0f0d0624903d', '83bf7a64-40a2-467e-8004-aa4de2048fee', '8769dc49-6bfa-4813-916f-92d444b25568'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:38 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Delete snapshot completed successfully. Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-cad19897-4a11-493f-a4d5-0914ab5ec9a7 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-ce7e9b00-292b-4c6e-a0dc-92115dd33210-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:38 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 1G" returned: 0 in 0.519s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-140cefbf-05e6-46e9-9799-69407d526ab2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:38 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-140cefbf-05e6-46e9-9799-69407d526ab2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 Sep 28 16:20:38 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-a92c9e39-f510-48bc-ba4b-10daab6fb843-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-a92c9e39-f510-48bc-ba4b-10daab6fb843-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "cinder-quobyte-a92c9e39-f510-48bc-ba4b-10daab6fb843" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-a92c9e39-f510-48bc-ba4b-10daab6fb843" acquired by "delete_volume" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[928879f7-117c-4d7c-9978-c60c0c184ab2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 Sep 28 16:20:39 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-140cefbf-05e6-46e9-9799-69407d526ab2 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4" returned: 0 in 0.400s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 is being set with open permissions: ugo+rw Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 Sep 28 16:20:39 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4" returned: 0 in 0.305s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843" returned: 0 in 0.449s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843 Sep 28 16:20:39 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info Sep 28 16:20:39 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-a92c9e39-f510-48bc-ba4b-10daab6fb843" returned: 0 in 0.316s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-quobyte-a92c9e39-f510-48bc-ba4b-10daab6fb843" released by "delete_volume" :: held 0.851s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:39 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info" returned: 0 in 0.364s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info is being set with open permissions: ugo+rw Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Created reservations ['247d8111-d49c-474a-8e0f-f09e2f6c7e57', 'fbb69e70-8b67-4a2b-a0d1-23a3c2f9dc6b', 'd38077d2-ba7e-412e-9e72-951ea2f0c0f9', '3a5db25d-9b88-47d6-b815-0216ea3a67ce'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:39 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info Sep 28 16:20:39 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:40 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:40 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:40 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.info" returned: 0 in 0.319s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ab94d109-2668-4624-8e5c-df369efd2254 tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:20:40 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.360s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:40 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Deleted volume successfully. Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1f445a4f-8608-4be0-8cef-12fa6b538ba1 tempest-ProjectReaderTests-2062210395 None] Lock "cinder-a92c9e39-f510-48bc-ba4b-10daab6fb843-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-a8447352-ccfa-4ff1-944c-55495430acc4-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-a8447352-ccfa-4ff1-944c-55495430acc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-140cefbf-05e6-46e9-9799-69407d526ab2" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-140cefbf-05e6-46e9-9799-69407d526ab2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-a8447352-ccfa-4ff1-944c-55495430acc4" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-a8447352-ccfa-4ff1-944c-55495430acc4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot a8447352-ccfa-4ff1-944c-55495430acc4 of volume 140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a26360-971a-43e6-b75c-e170beca119e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:41 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 Sep 28 16:20:41 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:41 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4" returned: 0 in 0.463s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:41 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-140cefbf-05e6-46e9-9799-69407d526ab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:41 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b97abb-118c-40ce-9e72-03118ceeb41e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:41 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 Sep 28 16:20:41 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:41 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2" returned: 0 in 0.454s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:41 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:41 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 Sep 28 16:20:41 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:42 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4" returned: 0 in 0.415s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:42 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4 Sep 28 16:20:42 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:42 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2.a8447352-ccfa-4ff1-944c-55495430acc4" returned: 0 in 0.285s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-a8447352-ccfa-4ff1-944c-55495430acc4" released by "_delete_snapshot" :: held 1.749s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-140cefbf-05e6-46e9-9799-69407d526ab2" released by "delete_snapshot" :: held 1.780s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Created reservations ['c7929521-9512-429e-b507-36d6c9aca49d', '45fba4bc-1986-435a-988c-280f146a3ebc', 'd3efc6e5-cd92-4e89-8de1-2a6cce3b7ea0', 'edac1290-16ab-4f65-8b6f-d19d805d6b6d'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:42 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:20:42 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-7bee6c22-e4cb-4553-a78f-bc6705e64d37 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-a8447352-ccfa-4ff1-944c-55495430acc4-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-140cefbf-05e6-46e9-9799-69407d526ab2-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-140cefbf-05e6-46e9-9799-69407d526ab2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-140cefbf-05e6-46e9-9799-69407d526ab2" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-140cefbf-05e6-46e9-9799-69407d526ab2" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f69026-3a50-4598-aa1a-912d20a84850]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:43 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 Sep 28 16:20:43 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:43 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2" returned: 0 in 0.467s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:43 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:43 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2 Sep 28 16:20:43 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:43 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-140cefbf-05e6-46e9-9799-69407d526ab2" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-140cefbf-05e6-46e9-9799-69407d526ab2" released by "delete_volume" :: held 0.881s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:UPDATE=217,cinder:SELECT=171,cinder:INSERT=61,cinder:DELETE=19 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=171,cinder:INSERT=58,cinder:UPDATE=228,cinder:DELETE=18 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Created reservations ['c68c26bc-860e-4f54-a7e4-7ab63455012a', 'f1007f0f-761c-4075-83c1-35e040f5be77', '81369ebb-ee35-4745-b680-3a392b5814eb', 'a4d63f7d-d8b3-4f2e-a1c5-4f3cb76e13e0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:44 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:44 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:44 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.355s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:44 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-27cd92ef-6fbb-4890-9df8-4e929f3dd9c7 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-140cefbf-05e6-46e9-9799-69407d526ab2-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:44 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (903a94de-e549-4bb2-bc4d-d60c73a68325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2974ef85-0f73-4a6e-8650-2042f3d94471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2974ef85-0f73-4a6e-8650-2042f3d94471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139697890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3918a95-69ac-49d8-bb81-f41cdcd2af6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:45Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b87538-010e-455d-83e5-4af2dc55c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b87538-010e-455d-83e5-4af2dc55c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3326948e-bdb4-41cf-9f18-df7802972470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3326948e-bdb4-41cf-9f18-df7802972470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3918a95-69ac-49d8-bb81-f41cdcd2af6a', 'volume_name': 'volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6a4d99-4de5-46e3-9500-3d19a511726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6a4d99-4de5-46e3-9500-3d19a511726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fe9218-c42b-476d-9dee-f294fecdc755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:45 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Volume d3918a95-69ac-49d8-bb81-f41cdcd2af6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a', 'volume_size': 1} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139697890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3918a95-69ac-49d8-bb81-f41cdcd2af6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:45Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Creating volume d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:45 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:45 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a 1073741824 Sep 28 16:20:45 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:45 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a 1073741824" returned: 0 in 0.621s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:45 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:45 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a Sep 28 16:20:45 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:46 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" returned: 0 in 0.297s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fe9218-c42b-476d-9dee-f294fecdc755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369c9924-c141-45f7-b7dc-5c312123dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:46 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Volume volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a (d3918a95-69ac-49d8-bb81-f41cdcd2af6a): created successfully Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369c9924-c141-45f7-b7dc-5c312123dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:46 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (903a94de-e549-4bb2-bc4d-d60c73a68325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:46 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-af31bfac-5400-4f98-8be2-7574e6c06d39 tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot 8a74472e-ac40-43ed-9090-a2498514ee02 of volume d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea5ca06-a930-49ff-a190-5ed2a142abbf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:47 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a Sep 28 16:20:47 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:47 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" returned: 0 in 0.532s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:47 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:47 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 1G Sep 28 16:20:47 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:48 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 1G" returned: 0 in 0.553s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:48 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 Sep 28 16:20:48 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:48 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02" returned: 0 in 0.330s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:48 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 is being set with open permissions: ugo+rw Sep 28 16:20:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:48 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 Sep 28 16:20:48 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:48 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02" returned: 0 in 0.259s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:48 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:49 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info Sep 28 16:20:49 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:49 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info" returned: 0 in 0.294s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:49 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info is being set with open permissions: ugo+rw Sep 28 16:20:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:49 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info Sep 28 16:20:49 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:49 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.info" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:49 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:49 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-bf57fb2e-c443-404c-8daa-08b846658022 tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-8a74472e-ac40-43ed-9090-a2498514ee02-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-8a74472e-ac40-43ed-9090-a2498514ee02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-8a74472e-ac40-43ed-9090-a2498514ee02" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-8a74472e-ac40-43ed-9090-a2498514ee02" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot 8a74472e-ac40-43ed-9090-a2498514ee02 of volume d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c720163-99f0-48c2-8cd7-b6039ed0d12d]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:50 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:50 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 Sep 28 16:20:50 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:51 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02" returned: 0 in 0.579s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:51 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:51 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa7911a-3e57-4bd7-a7f6-407338ab985b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:51 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a Sep 28 16:20:51 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:51 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" returned: 0 in 0.488s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:51 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:51 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 Sep 28 16:20:51 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:52 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02" returned: 0 in 0.500s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:52 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02 Sep 28 16:20:52 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:52 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a.8a74472e-ac40-43ed-9090-a2498514ee02" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-8a74472e-ac40-43ed-9090-a2498514ee02" released by "_delete_snapshot" :: held 2.127s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" released by "delete_snapshot" :: held 2.151s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Created reservations ['e3fde3fe-0297-491d-bf47-4c8ac30b5698', 'f7df6bb4-9087-4d78-b071-c7bf54b9947f', 'cea464fa-cfe6-4786-8f56-8fc18150c288', '30f78212-573a-4c47-aca2-dbbb63853632'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:52 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:20:52 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3124fd20-bd67-486a-b0bd-cfa758e60554 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-8a74472e-ac40-43ed-9090-a2498514ee02-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-d3918a95-69ac-49d8-bb81-f41cdcd2af6a-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-d3918a95-69ac-49d8-bb81-f41cdcd2af6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:53 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:53 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec1b2c9-a896-4a1f-be9d-8fb3b940424b]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:53 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:54 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a Sep 28 16:20:54 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:54 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" returned: 0 in 0.480s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:54 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a Sep 28 16:20:54 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:54 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" returned: 0 in 0.403s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-d3918a95-69ac-49d8-bb81-f41cdcd2af6a" released by "delete_volume" :: held 0.992s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Created reservations ['0c1f5259-2e95-4388-8135-22f6d03274fe', 'db2c2bda-5042-4ec4-8a01-41e8d1b03dd8', '935aa04b-5e3b-4801-b889-2d261c99cab0', '59fea7d0-079f-41db-85bc-01df8f77df21'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:54 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:55 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:20:55 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:55 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:55 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.331s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:55 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:55 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:20:55 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-21cf06cb-4742-49e4-b4cd-bcb7531dfff6 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-d3918a95-69ac-49d8-bb81-f41cdcd2af6a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (98861615-84a8-4d46-bece-690e064fca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfd0e1a-4a83-473c-ae6f-bee6328e5db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfd0e1a-4a83-473c-ae6f-bee6328e5db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957159519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc030ea0-3fcb-4806-b055-0667bf8bbbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:57Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c455aff-25ea-4a8d-ab02-fe67f5e5f267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c455aff-25ea-4a8d-ab02-fe67f5e5f267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dfcc23-cbc0-48f7-a774-3b130bbfe775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dfcc23-cbc0-48f7-a774-3b130bbfe775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc030ea0-3fcb-4806-b055-0667bf8bbbd1', 'volume_name': 'volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5dc4ec1-3384-4b8e-a0e0-aefb6b162915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5dc4ec1-3384-4b8e-a0e0-aefb6b162915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d7430c-eb11-47ff-9405-3c894d0a2915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:56 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Volume cc030ea0-3fcb-4806-b055-0667bf8bbbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1', 'volume_size': 1} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1957159519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc030ea0-3fcb-4806-b055-0667bf8bbbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:57Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Creating volume cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:56 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:20:56 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:56 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 1073741824 Sep 28 16:20:56 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:57 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 1073741824" returned: 0 in 0.544s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:57 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 Sep 28 16:20:57 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:57 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" returned: 0 in 0.348s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d7430c-eb11-47ff-9405-3c894d0a2915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fc7a96-23fa-4647-b5d7-d78fef964ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:57 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Volume volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 (cc030ea0-3fcb-4806-b055-0667bf8bbbd1): created successfully Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fc7a96-23fa-4647-b5d7-d78fef964ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:57 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (98861615-84a8-4d46-bece-690e064fca9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:57 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ee3965f5-257f-44de-ab9a-4e8203e689f4 tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:20:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:58 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:58 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 of volume cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:59 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddfbe53-5fe4-4870-b3aa-c1dc6e9735c0]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:59 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 Sep 28 16:20:59 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:59 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" returned: 0 in 0.419s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:59 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 1G Sep 28 16:20:59 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:59 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 1G" returned: 0 in 0.468s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:59 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:59 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 Sep 28 16:20:59 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:00 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:00 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 is being set with open permissions: ugo+rw Sep 28 16:21:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:00 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 Sep 28 16:21:00 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:00 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" returned: 0 in 0.332s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:00 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:00 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info Sep 28 16:21:00 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:01 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info" returned: 0 in 0.307s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:01 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info is being set with open permissions: ugo+rw Sep 28 16:21:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:01 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info Sep 28 16:21:01 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:01 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.info" returned: 0 in 0.289s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:01 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:01 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-9a6fae8d-72b1-4388-9f9d-e356d7e40f3f tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-cbb8381f-27e5-41bf-9ec2-a2d80bac1da5-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Lock "cinder-cbb8381f-27e5-41bf-9ec2-a2d80bac1da5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 of volume cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d57617-7253-490a-9930-a15c9be78ade]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:02 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 Sep 28 16:21:02 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:02 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" returned: 0 in 0.401s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[82afddc6-de3d-44c4-ab22-1e410899ae06]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:02 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:02 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 Sep 28 16:21:02 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:03 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" returned: 0 in 0.386s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:03 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 Sep 28 16:21:03 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:03 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" returned: 0 in 0.377s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:03 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5 Sep 28 16:21:03 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:03 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1.cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" returned: 0 in 0.317s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-cbb8381f-27e5-41bf-9ec2-a2d80bac1da5" released by "_delete_snapshot" :: held 1.609s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" released by "delete_snapshot" :: held 1.637s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:03 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Created reservations ['0000b553-21d0-41d2-8bbf-fa64c09bae9d', '8ff28440-b21c-448d-8278-1f5cd73ea6c6', 'bfab847f-ed38-4ac9-8add-0fddcc91f3c7', '999284f2-9abe-4017-a504-aa2d9d4eb8e8'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:04 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3102bbb9-f5e4-421c-b09d-32277050c41a tempest-ProjectMemberTests-1421157248 None] Lock "cinder-cbb8381f-27e5-41bf-9ec2-a2d80bac1da5-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-cc030ea0-3fcb-4806-b055-0667bf8bbbd1-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-cc030ea0-3fcb-4806-b055-0667bf8bbbd1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" acquired by "delete_volume" :: waited 0.013s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[066bb158-bcf0-424e-b145-877e1cd82384]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:04 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:04 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 Sep 28 16:21:04 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:05 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" returned: 0 in 0.446s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:05 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1 Sep 28 16:21:05 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:05 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" returned: 0 in 0.283s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-cc030ea0-3fcb-4806-b055-0667bf8bbbd1" released by "delete_volume" :: held 0.813s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Created reservations ['c2c6c063-b186-48e4-9311-c531b14979f7', '1eba8d52-9e91-47e6-af98-04d7b2c0c394', '1cbf5b16-133f-4bc3-8b57-8a88aaef6ae1', '3fab0586-4129-48a0-af92-6f4bfae3604f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:05 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:05 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:05 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.346s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:05 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:21:05 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0709fb63-9914-4bc2-9e63-b0d8a3d992b4 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-cc030ea0-3fcb-4806-b055-0667bf8bbbd1-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (5bee81c8-ba22-4dc6-93d9-32efc5a32e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce557c2-f621-4cd0-a64d-06bfa4cd2a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce557c2-f621-4cd0-a64d-06bfa4cd2a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975642565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d939ae0-9949-4a16-a259-6d682f40fd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:06Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee10cf9-f51f-4f8a-b129-ee06bb769e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee10cf9-f51f-4f8a-b129-ee06bb769e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c51490-7116-4847-b389-46719545dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c51490-7116-4847-b389-46719545dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d939ae0-9949-4a16-a259-6d682f40fd26', 'volume_name': 'volume-4d939ae0-9949-4a16-a259-6d682f40fd26', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49ac718-8662-4cb9-a884-c5b83fd0ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49ac718-8662-4cb9-a884-c5b83fd0ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e47b7a-8482-4da8-8dd6-d5248bdd713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:06 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Volume 4d939ae0-9949-4a16-a259-6d682f40fd26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d939ae0-9949-4a16-a259-6d682f40fd26', 'volume_size': 1} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975642565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d939ae0-9949-4a16-a259-6d682f40fd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:06Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Creating volume 4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:06 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:06 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 1073741824 Sep 28 16:21:06 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:06 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 1073741824" returned: 0 in 0.548s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:06 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:07 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 Sep 28 16:21:07 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:07 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26" returned: 0 in 0.341s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e47b7a-8482-4da8-8dd6-d5248bdd713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d939ae0-9949-4a16-a259-6d682f40fd26', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc40f0d7-2eac-4eba-bcdc-abeb3bb2a94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:07 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Volume volume-4d939ae0-9949-4a16-a259-6d682f40fd26 (4d939ae0-9949-4a16-a259-6d682f40fd26): created successfully Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc40f0d7-2eac-4eba-bcdc-abeb3bb2a94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:07 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (5bee81c8-ba22-4dc6-93d9-32efc5a32e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:07 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-247b6049-b2b2-479b-8bde-40e947514463 tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot d924616b-a01f-4158-a743-a2cc28ba5104 of volume 4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[050d2168-19ba-4310-99d3-394bb7269afb]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:08 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 Sep 28 16:21:08 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Flow 'volume_create_manager' (a8f6a8ed-2d0e-4ace-a6f9-370113f7d617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4537401-9e29-495d-b9cf-1762e838f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4537401-9e29-495d-b9cf-1762e838f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-844883596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a433f9b-4448-4d0d-a97b-8d46d7ce28b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b45961cca2441c8a8968e85dff2eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:09Z,use_quota=True,user_id='d57e2a6b897d4c2dbbb90f63f76ec8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a6b077-6694-48d0-b1a1-98b10b9490d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a6b077-6694-48d0-b1a1-98b10b9490d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a385317a-18a1-41a9-b1af-bf1c5288e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a385317a-18a1-41a9-b1af-bf1c5288e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a433f9b-4448-4d0d-a97b-8d46d7ce28b7', 'volume_name': 'volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417afde2-2e18-42d1-b9f0-9db4123fe338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417afde2-2e18-42d1-b9f0-9db4123fe338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8023ed4b-fe52-4e69-9d0b-68052ddaeba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:08 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Volume 4a433f9b-4448-4d0d-a97b-8d46d7ce28b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7', 'volume_size': 1} Sep 28 16:21:08 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:09 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26" returned: 0 in 0.413s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:09 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 1G Sep 28 16:21:09 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:09 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 1G" returned: 0 in 0.410s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d939ae0-9949-4a16-a259-6d682f40fd26 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:09 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d939ae0-9949-4a16-a259-6d682f40fd26 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 Sep 28 16:21:09 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:09 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d939ae0-9949-4a16-a259-6d682f40fd26 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104" returned: 0 in 0.324s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:09 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 is being set with open permissions: ugo+rw Sep 28 16:21:09 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:09 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 Sep 28 16:21:09 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:10 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104" returned: 0 in 0.288s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:10 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info Sep 28 16:21:10 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:10 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info" returned: 0 in 0.284s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:10 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info is being set with open permissions: ugo+rw Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:10 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info Sep 28 16:21:10 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:10 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.info" returned: 0 in 0.266s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-844883596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a433f9b-4448-4d0d-a97b-8d46d7ce28b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b45961cca2441c8a8968e85dff2eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:09Z,use_quota=True,user_id='d57e2a6b897d4c2dbbb90f63f76ec8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Creating volume 4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:10 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:21:10 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:10 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 1073741824 Sep 28 16:21:10 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:10 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-cd01fda7-bdd0-41cb-af52-9555a1abe15d tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:21:11 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 1073741824" returned: 0 in 0.477s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:11 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 Sep 28 16:21:11 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:11 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" returned: 0 in 0.282s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8023ed4b-fe52-4e69-9d0b-68052ddaeba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbd17e2-3a91-4e74-83c3-04516ee0e0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:11 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Volume volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 (4a433f9b-4448-4d0d-a97b-8d46d7ce28b7): created successfully Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbd17e2-3a91-4e74-83c3-04516ee0e0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Flow 'volume_create_manager' (a8f6a8ed-2d0e-4ace-a6f9-370113f7d617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:11 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-c510ea98-4365-4315-975c-67568a1e0817 tempest-SnapshotDependencyTests-1431844696 None] Created volume successfully. Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-d924616b-a01f-4158-a743-a2cc28ba5104-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Lock "cinder-d924616b-a01f-4158-a743-a2cc28ba5104-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-4d939ae0-9949-4a16-a259-6d682f40fd26" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-4d939ae0-9949-4a16-a259-6d682f40fd26" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-d924616b-a01f-4158-a743-a2cc28ba5104" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-d924616b-a01f-4158-a743-a2cc28ba5104" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot d924616b-a01f-4158-a743-a2cc28ba5104 of volume 4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[838f7815-d708-4b95-afc4-ae782889c5c9]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:11 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:11 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 Sep 28 16:21:12 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104" returned: 0 in 0.505s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d939ae0-9949-4a16-a259-6d682f40fd26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424d4df-904e-41ea-9e96-b2aa8debed99]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Creating offline snapshot 0555ab08-b824-4dd2-93b7-90a279083bff of volume 4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3945c2-9d75-42a1-8da6-02c925f05d5a]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 Sep 28 16:21:12 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 Sep 28 16:21:12 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26" returned: 0 in 0.471s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 Sep 28 16:21:12 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" returned: 0 in 0.443s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:12 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff 1G Sep 28 16:21:12 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:13 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104" returned: 0 in 0.419s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:13 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104 Sep 28 16:21:13 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:13 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff 1G" returned: 0 in 0.531s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:13 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff Sep 28 16:21:13 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:13 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26.d924616b-a01f-4158-a743-a2cc28ba5104" returned: 0 in 0.318s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-d924616b-a01f-4158-a743-a2cc28ba5104" released by "_delete_snapshot" :: held 1.840s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-4d939ae0-9949-4a16-a259-6d682f40fd26" released by "delete_snapshot" :: held 1.868s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Created reservations ['73e0eb84-8342-4d05-a624-9e125dd4b492', 'cbfb9266-698c-4bdb-8bef-d8f157fab2a6', '85d0969a-b459-4285-aaac-df2794e12ca1', 'fd7c4691-50dd-42f4-85b9-cb65d9dbc43f'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:13 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff" returned: 0 in 0.360s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff is being set with open permissions: ugo+rw Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:13 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:21:13 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff Sep 28 16:21:13 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-eb4ea812-c37c-46a2-8659-06d38f5b9c4c tempest-ProjectMemberTests-1421157248 None] Lock "cinder-d924616b-a01f-4158-a743-a2cc28ba5104-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:13 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-4d939ae0-9949-4a16-a259-6d682f40fd26-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Lock "cinder-4d939ae0-9949-4a16-a259-6d682f40fd26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-4d939ae0-9949-4a16-a259-6d682f40fd26" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-4d939ae0-9949-4a16-a259-6d682f40fd26" acquired by "delete_volume" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:14 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff" returned: 0 in 0.308s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f5591-b8e4-4ce4-92f2-2cb7dc29414e]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:14 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info Sep 28 16:21:14 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:14 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 Sep 28 16:21:14 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:14 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info" returned: 0 in 0.282s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:14 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info is being set with open permissions: ugo+rw Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:14 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info Sep 28 16:21:14 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:14 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26" returned: 0 in 0.469s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:14 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26 Sep 28 16:21:14 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:14 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.info" returned: 0 in 0.268s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:14 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-ea1e1401-e089-4f02-96d1-1bace35b5f98 tempest-SnapshotDependencyTests-1431844696 None] Create snapshot completed successfully Sep 28 16:21:14 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4d939ae0-9949-4a16-a259-6d682f40fd26" returned: 0 in 0.286s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-4d939ae0-9949-4a16-a259-6d682f40fd26" released by "delete_volume" :: held 0.837s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:14 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Created reservations ['225ea13e-24e0-461a-89d6-c096393fbbc1', '022301ba-7027-47a3-a54f-ac9c221a57c8', '7ebf9c6b-5900-4e29-975e-e31fa4aeb5bf', '9ac05865-5338-441a-8607-0396a0a54b4b'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:15 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:15 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:15 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.269s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:15 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-94c20c1c-3619-4fba-bf43-a1e30a827dca tempest-ProjectMemberTests-1421157248 None] Lock "cinder-4d939ae0-9949-4a16-a259-6d682f40fd26-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (4d311b40-61fe-41b9-8947-ddacd89858ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55284975-3a2c-446d-a127-f8935ddae6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55284975-3a2c-446d-a127-f8935ddae6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338904703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0870c8fc-30ec-4fa3-a217-9ef6a56cc504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:16Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c3d956-bc12-4f16-8033-3cf2e3f5f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c3d956-bc12-4f16-8033-3cf2e3f5f32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35862fac-5b68-4ff7-af17-ca8797a06762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35862fac-5b68-4ff7-af17-ca8797a06762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0870c8fc-30ec-4fa3-a217-9ef6a56cc504', 'volume_name': 'volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1782f8d-3a03-438d-9eae-5a8e075898ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1782f8d-3a03-438d-9eae-5a8e075898ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f56968-28f8-4084-9753-7c0aeaa08b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Volume 0870c8fc-30ec-4fa3-a217-9ef6a56cc504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504', 'volume_size': 1} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338904703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0870c8fc-30ec-4fa3-a217-9ef6a56cc504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:16Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Creating volume 0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:15 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:21:15 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:15 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 1073741824 Sep 28 16:21:15 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Flow 'volume_create_manager' (bcc5c1cb-52d9-43ad-ac29-d05414466ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017027d0-586e-4dd7-9c92-659c38eca9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 1073741824" returned: 0 in 0.472s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017027d0-586e-4dd7-9c92-659c38eca9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52baf479-b9f2-4b50-9ec8-1f3399e85fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b45961cca2441c8a8968e85dff2eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0555ab08-b824-4dd2-93b7-90a279083bff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:16Z,use_quota=True,user_id='d57e2a6b897d4c2dbbb90f63f76ec8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4b5aa9-3cc1-47c6-b025-67a81e3dc66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4b5aa9-3cc1-47c6-b025-67a81e3dc66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae06fc3-be5f-412a-95d7-1fdef50bed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae06fc3-be5f-412a-95d7-1fdef50bed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52baf479-b9f2-4b50-9ec8-1f3399e85fbf', 'volume_name': 'volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf', 'volume_size': 1, 'snapshot_id': '0555ab08-b824-4dd2-93b7-90a279083bff'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e201c5-b064-4c81-bd28-6ddb942d791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e201c5-b064-4c81-bd28-6ddb942d791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6bb18a-dbcd-4eb9-92bb-198511fc6c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Volume 52baf479-b9f2-4b50-9ec8-1f3399e85fbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf', 'volume_size': 1, 'snapshot_id': '0555ab08-b824-4dd2-93b7-90a279083bff'} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:16 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 Sep 28 16:21:16 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:16 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" returned: 0 in 0.253s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.280s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-quobyte-0555ab08-b824-4dd2-93b7-90a279083bff-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" by "_create_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f56968-28f8-4084-9753-7c0aeaa08b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6819d-727d-4a43-b3c9-7d10c3f475a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-0555ab08-b824-4dd2-93b7-90a279083bff-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Creating volume 52baf479-b9f2-4b50-9ec8-1f3399e85fbf from snapshot 0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-quobyte-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" by "_copy_volume_from_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:16 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Volume volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 (0870c8fc-30ec-4fa3-a217-9ef6a56cc504): created successfully Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6819d-727d-4a43-b3c9-7d10c3f475a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (4d311b40-61fe-41b9-8947-ddacd89858ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] snapshot: 0555ab08-b824-4dd2-93b7-90a279083bff, volume: 52baf479-b9f2-4b50-9ec8-1f3399e85fbf, {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:16 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b9ac1683-6c4b-4099-999f-032c38eae397 tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d42fa-3b41-493a-9fd8-f36001e45d2c]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:16 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:16 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff Sep 28 16:21:16 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:17 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff" returned: 0 in 0.411s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c461368-53b2-4b68-87cc-3d3d771d45cd]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:17 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 Sep 28 16:21:17 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:17 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" returned: 0 in 0.383s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Creating direct copy from snapshot {{(pid=86628) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG cinder.utils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Path /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf not found in is_blk_device check {{(pid=86628) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:21:17 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:17 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf Sep 28 16:21:17 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:18 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:23 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" returned: 0 in 6.036s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:23 devstack cinder-volume[86628]: DEBUG cinder.image.image_utils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Image conversion details: src /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf {{(pid=86628) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:21:23 devstack cinder-volume[86628]: INFO cinder.image.image_utils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Converted 1024.00 MB image at 169.61 MB/s Sep 28 16:21:23 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf is being set with open permissions: ugo+rw Sep 28 16:21:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:23 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf Sep 28 16:21:23 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:23 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:23 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" returned: 0 in 0.279s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:23 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" released by "_copy_volume_from_snapshot" :: held 7.209s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-0555ab08-b824-4dd2-93b7-90a279083bff-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" released by "_create_volume_from_snapshot" :: held 7.297s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.334s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.958s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot 740313db-0ef7-42d6-b02a-feafd5b0c67c of volume 0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6bb18a-dbcd-4eb9-92bb-198511fc6c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf', 'volume_size': 1, 'snapshot_id': '0555ab08-b824-4dd2-93b7-90a279083bff'}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d629555d-d1e8-4315-a868-a496a1da44e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6966755-60bb-4c5c-90cf-2cc3dd9b53bf]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:24 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Volume volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf (52baf479-b9f2-4b50-9ec8-1f3399e85fbf): created successfully Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d629555d-d1e8-4315-a868-a496a1da44e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Flow 'volume_create_manager' (bcc5c1cb-52d9-43ad-ac29-d05414466ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:24 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f8783daf-778a-47f4-b2e8-73e1deebe511 tempest-SnapshotDependencyTests-1431844696 None] Created volume successfully. Sep 28 16:21:24 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 Sep 28 16:21:24 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:24 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" returned: 0 in 0.443s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:24 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c 1G Sep 28 16:21:24 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:24 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c 1G" returned: 0 in 0.449s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:24 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:24 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c Sep 28 16:21:24 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-0555ab08-b824-4dd2-93b7-90a279083bff-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-0555ab08-b824-4dd2-93b7-90a279083bff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-quobyte-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-quobyte-0555ab08-b824-4dd2-93b7-90a279083bff" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-0555ab08-b824-4dd2-93b7-90a279083bff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Deleting offline snapshot 0555ab08-b824-4dd2-93b7-90a279083bff of volume 4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] snapshot_file for this snap is: volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d00ca1-36fa-4919-b32b-847ad43c8cf2]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c" returned: 0 in 0.363s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c is being set with open permissions: ugo+rw Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c Sep 28 16:21:25 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff Sep 28 16:21:25 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c" returned: 0 in 0.270s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info Sep 28 16:21:25 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff" returned: 0 in 0.451s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[35412a27-0d51-49d6-8308-b89600b045f1]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 Sep 28 16:21:25 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info" returned: 0 in 0.318s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info is being set with open permissions: ugo+rw Sep 28 16:21:25 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info Sep 28 16:21:25 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:26 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.info" returned: 0 in 0.315s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:26 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-b6081178-0333-4400-9cae-250302b368c5 tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:21:26 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" returned: 0 in 0.649s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:26 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff Sep 28 16:21:26 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-740313db-0ef7-42d6-b02a-feafd5b0c67c-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-740313db-0ef7-42d6-b02a-feafd5b0c67c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-740313db-0ef7-42d6-b02a-feafd5b0c67c" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-740313db-0ef7-42d6-b02a-feafd5b0c67c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot 740313db-0ef7-42d6-b02a-feafd5b0c67c of volume 0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46d1d0-ab3d-429b-adae-ced036d9fe29]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:26 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c Sep 28 16:21:26 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:26 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:26 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:26 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff" returned: 0 in 0.439s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:26 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff Sep 28 16:21:26 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:27 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c" returned: 0 in 0.473s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:27 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:27 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.384s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7.0555ab08-b824-4dd2-93b7-90a279083bff" returned: 0 in 0.342s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb663c-ddd1-4fce-8650-7169a8955ff5]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-0555ab08-b824-4dd2-93b7-90a279083bff" released by "_delete_snapshot" :: held 2.041s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" released by "delete_snapshot" :: held 2.072s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:27 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 Sep 28 16:21:27 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Created reservations ['dc8573a6-acd8-4b24-831a-dfcce35b2efe', '09b1dedc-284f-4437-8921-3f65d12f15c1', '4e3ab0eb-818c-481a-826c-fed55897b6b1', 'f3058e94-890d-4f9e-b5d4-5b9bab28d001'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:27 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Delete snapshot completed successfully. Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0f3446b3-b775-4473-9e49-ddb3c08dfb66 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-0555ab08-b824-4dd2-93b7-90a279083bff-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:27 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" returned: 0 in 0.482s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:27 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c Sep 28 16:21:27 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:28 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c" returned: 0 in 0.408s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:28 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c Sep 28 16:21:28 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:28 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504.740313db-0ef7-42d6-b02a-feafd5b0c67c" returned: 0 in 0.275s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-740313db-0ef7-42d6-b02a-feafd5b0c67c" released by "_delete_snapshot" :: held 1.769s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" released by "delete_snapshot" :: held 1.803s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-quobyte-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" acquired by "delete_volume" :: waited 0.028s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Created reservations ['5c78dfdf-7ba4-4058-877b-f73f31fbf44e', 'dc6016ce-761f-458c-be0d-c7b21f6f2662', 'eec11dff-9cbd-4fd2-9561-6865baeae33e', '5d4b5922-a159-48d0-9785-1f3f999d9689'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bdf391-2d2e-415f-8076-14cff6cb8786]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:28 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-f091ffb1-4e8c-4cf7-8936-c3fd948edfa0 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-740313db-0ef7-42d6-b02a-feafd5b0c67c-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:28 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 Sep 28 16:21:28 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-0870c8fc-30ec-4fa3-a217-9ef6a56cc504-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Lock "cinder-0870c8fc-30ec-4fa3-a217-9ef6a56cc504-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" acquired by "delete_volume" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04212b1-b898-43d1-af58-4eb5ea7c0934]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:28 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" returned: 0 in 0.458s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 Sep 28 16:21:29 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7 Sep 28 16:21:29 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" returned: 0 in 0.451s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" returned: 0 in 0.313s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504 Sep 28 16:21:29 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7" released by "delete_volume" :: held 0.855s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Created reservations ['52e76465-560d-4dea-945e-661cd92f63db', '1e37a973-644e-4fa3-a755-91fba74ca7a7', '3eebbb38-1db0-4d2b-8d0f-06e47e1391bd', 'ce4616c7-be2c-4a92-a1b1-ccf6997bc956'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-52baf479-b9f2-4b50-9ec8-1f3399e85fbf-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:29 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:29 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-52baf479-b9f2-4b50-9ec8-1f3399e85fbf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:29 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" returned: 0 in 0.374s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "cinder-quobyte-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-0870c8fc-30ec-4fa3-a217-9ef6a56cc504" released by "delete_volume" :: held 0.916s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" acquired by "delete_volume" :: waited 0.025s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a36b1-64b1-45a2-ba06-5f2ab52fb010]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Created reservations ['46023e59-221b-495f-b3f3-2d84227269af', 'a68e2963-adcb-4991-9a24-597d3eb97981', 'becd261f-1ba0-4842-bd55-98e4aa0ffe17', '470c03b6-3897-4981-a8ef-a092c5314bfc'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:29 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf Sep 28 16:21:29 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:29 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.435s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:30 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:30 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Deleted volume successfully. Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-0078828f-efdc-4f9b-ae59-950e89e93584 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-4a433f9b-4448-4d0d-a97b-8d46d7ce28b7-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:30 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" returned: 0 in 0.501s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.321s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:30 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf Sep 28 16:21:30 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:30 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3a2d7607-0bed-4cac-a814-2dff810e00ce tempest-ProjectMemberTests-1421157248 None] Lock "cinder-0870c8fc-30ec-4fa3-a217-9ef6a56cc504-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:30 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" returned: 0 in 0.294s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-quobyte-52baf479-b9f2-4b50-9ec8-1f3399e85fbf" released by "delete_volume" :: held 0.851s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Created reservations ['810d0aa1-d597-4dc1-828e-fa8d96783540', '2ca1402f-bc31-4bfc-a915-c5631ed32ef2', 'be235ab7-d56c-483e-a9a7-3771f7e29917', '755eb0d5-2705-46b7-98bd-5181eafc63b0'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:30 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:30 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:31 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.365s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:31 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Deleted volume successfully. Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-3df00824-b704-4970-9351-df8832f7c266 tempest-SnapshotDependencyTests-1431844696 None] Lock "cinder-52baf479-b9f2-4b50-9ec8-1f3399e85fbf-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.flows.manager.create_volume [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86628) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (8efed98f-98de-448b-b7ff-6830ac1bf1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714bca10-ee60-440b-91d7-e7713a62c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714bca10-ee60-440b-91d7-e7713a62c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99036149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f50368-4561-4cb8-826b-547d17d44704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:32Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ee0521-84fe-4948-b949-d3067e3eaf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ee0521-84fe-4948-b949-d3067e3eaf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9912b7f2-9eb8-436b-bd20-e3c8586a50f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9912b7f2-9eb8-436b-bd20-e3c8586a50f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f50368-4561-4cb8-826b-547d17d44704', 'volume_name': 'volume-b1f50368-4561-4cb8-826b-547d17d44704', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b116c5a2-9f2b-4be5-a27d-6d3149d883b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b116c5a2-9f2b-4be5-a27d-6d3149d883b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf90656-2979-4333-acdd-5c7ebf1859a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:31 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Volume b1f50368-4561-4cb8-826b-547d17d44704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f50368-4561-4cb8-826b-547d17d44704', 'volume_size': 1} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99036149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f50368-4561-4cb8-826b-547d17d44704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d346f284d64a9b83112adca2a487b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:32Z,use_quota=True,user_id='0d40a30c1e5049938fe2bfe00ed764d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d36998ac-f580-4209-92e5-029475824443),volume_type_id=d36998ac-f580-4209-92e5-029475824443)}" {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Creating volume b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Selected osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be as target Quobyte volume. {{(pid=86628) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:31 devstack cinder-volume[86628]: INFO cinder.volume.drivers.remotefs [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] casted to osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be Sep 28 16:21:31 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 1073741824 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 1073741824 Sep 28 16:21:31 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:32 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 1073741824" returned: 0 in 0.521s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:32 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 Sep 28 16:21:32 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:32 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'} {{(pid=86628) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf90656-2979-4333-acdd-5c7ebf1859a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f50368-4561-4cb8-826b-547d17d44704', 'volume_size': 1}' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6e119c-8d52-4404-b982-ebf0079d42d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:32 devstack cinder-volume[86628]: INFO cinder.volume.flows.manager.create_volume [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Volume volume-b1f50368-4561-4cb8-826b-547d17d44704 (b1f50368-4561-4cb8-826b-547d17d44704): created successfully Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6e119c-8d52-4404-b982-ebf0079d42d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86628) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:32 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Flow 'volume_create_manager' (8efed98f-98de-448b-b7ff-6830ac1bf1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86628) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:32 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-71845f20-82ab-4ebd-9978-a1cec311a44e tempest-ProjectMemberTests-1421157248 None] Created volume successfully. Sep 28 16:21:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:33 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Creating offline snapshot a0013545-565b-4a50-886d-555d20c30e85 of volume b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[7969fcbd-e561-4e13-b2cc-25685aeee2f6]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:34 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 Sep 28 16:21:34 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:34 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704" returned: 0 in 0.406s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 1G {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:34 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 1G Sep 28 16:21:34 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:34 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 1G" returned: 0 in 0.444s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:34 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f50368-4561-4cb8-826b-547d17d44704 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:34 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f50368-4561-4cb8-826b-547d17d44704 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 Sep 28 16:21:34 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f50368-4561-4cb8-826b-547d17d44704 -F qcow2 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85" returned: 0 in 0.420s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 is being set with open permissions: ugo+rw Sep 28 16:21:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 Sep 28 16:21:35 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85" returned: 0 in 0.314s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info Sep 28 16:21:35 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info" returned: 0 in 0.308s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[86628]: WARNING cinder.volume.drivers.remotefs [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info is being set with open permissions: ugo+rw Sep 28 16:21:35 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info Sep 28 16:21:36 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:36 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.info" returned: 0 in 0.380s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:36 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:36 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-15034999-ec45-47de-8752-3944e79a5da8 tempest-ProjectMemberTests-1421157248 None] Create snapshot completed successfully Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-a0013545-565b-4a50-886d-555d20c30e85-delete_snapshot" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-a0013545-565b-4a50-886d-555d20c30e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-b1f50368-4561-4cb8-826b-547d17d44704" by "delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b1f50368-4561-4cb8-826b-547d17d44704" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-a0013545-565b-4a50-886d-555d20c30e85" by "_delete_snapshot" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-a0013545-565b-4a50-886d-555d20c30e85" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Deleting offline snapshot a0013545-565b-4a50-886d-555d20c30e85 of volume b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] snapshot_file for this snap is: volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 {{(pid=86628) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f8779-9205-4089-a24d-117203c5e061]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:37 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 Sep 28 16:21:37 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:37 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85" returned: 0 in 0.407s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.remotefs [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f50368-4561-4cb8-826b-547d17d44704(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86628) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[84734f91-15ba-43f5-9bb0-8e54cc29d865]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:37 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:38 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 Sep 28 16:21:38 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:38 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704" returned: 0 in 0.437s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:38 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 Sep 28 16:21:38 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:38 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85" returned: 0 in 0.423s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:38 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:38 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85 Sep 28 16:21:38 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:39 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704.a0013545-565b-4a50-886d-555d20c30e85" returned: 0 in 0.301s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-a0013545-565b-4a50-886d-555d20c30e85" released by "_delete_snapshot" :: held 1.750s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b1f50368-4561-4cb8-826b-547d17d44704" released by "delete_snapshot" :: held 1.776s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Created reservations ['856699f1-8003-48ae-bfa1-9ffd85983143', '83189ddb-aef7-4c29-9f68-563f2b357428', '7438d689-84a0-4d8f-96d8-34d39bd8c8f3', 'bd6c3d2a-62f4-44bb-851f-8766deea7b41'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:39 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Delete snapshot completed successfully. Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-1b661656-1e6d-47f1-8d42-5bdebb5a5212 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-a0013545-565b-4a50-886d-555d20c30e85-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-b1f50368-4561-4cb8-826b-547d17d44704-delete_volume" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-b1f50368-4561-4cb8-826b-547d17d44704-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "cinder-quobyte-b1f50368-4561-4cb8-826b-547d17d44704" by "delete_volume" {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b1f50368-4561-4cb8-826b-547d17d44704" acquired by "delete_volume" :: waited 0.016s {{(pid=86628) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399ccb5-b868-4aae-87fa-295db339ef82]: (4, 'qcow2') {{(pid=88289) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:39 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:39 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 Sep 28 16:21:39 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704" returned: 0 in 0.442s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:40 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704 Sep 28 16:21:40 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43/volume-b1f50368-4561-4cb8-826b-547d17d44704" returned: 0 in 0.349s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-quobyte-b1f50368-4561-4cb8-826b-547d17d44704" released by "delete_volume" :: held 0.858s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG cinder.quota [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Created reservations ['5e6b400b-70b8-490e-bebb-df438e84c6ee', '4d5a76a1-5851-4674-8427-83af25ed8bb4', '9805a819-a009-44d8-821d-82266ea69e02', '3a9608ad-21d0-45fe-9c0c-17e86d874259'] {{(pid=86628) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:40 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:21:40 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.368s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:41 devstack cinder-volume[86628]: INFO cinder.volume.manager [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Deleted volume successfully. Sep 28 16:21:41 devstack cinder-volume[86628]: DEBUG cinder.coordination [None req-611957af-a59d-49ad-8047-b2e186617d59 tempest-ProjectMemberTests-1421157248 None] Lock "cinder-b1f50368-4561-4cb8-826b-547d17d44704-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86628) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:51 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:SELECT=101,cinder:INSERT=35,cinder:UPDATE=126,cinder:DELETE=10 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:21:53 devstack cinder-volume[86628]: DEBUG dbcounter [-] [86628] Writing DB stats cinder:INSERT=34,cinder:UPDATE=128,cinder:SELECT=95,cinder:DELETE=11 {{(pid=86628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be': None} {{(pid=86628) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG cinder.volume.drivers.quobyte [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-005c448b-6366-48c3-af59-b2123dec40be'] {{(pid=86628) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.lockutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86628) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:26 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:26 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43 Sep 28 16:22:26 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:27 devstack cinder-volume[86628]: DEBUG oslo_concurrency.processutils [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1e284deae9f46c09544eed69daa60b43" returned: 0 in 0.286s {{(pid=86628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:27 devstack cinder-volume[86628]: DEBUG cinder.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Notifying Schedulers of capabilities ... {{(pid=86628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:27 devstack cinder-volume[86628]: DEBUG oslo_service.periodic_task [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:22:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread count: 28 {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:22:27 devstack cinder-volume[86628]: DEBUG cinder.volume.manager [None req-fc09b4e9-58d8-4dee-a4a4-20c58e43b8b4 None None] thread info: [<_MainThread(MainThread, started 130731747254400)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}